-- Logs begin at Fri 2022-09-09 12:43:36 UTC, end at Fri 2022-09-09 13:47:21 UTC. -- Sep 09 13:09:48.845867 dv-cinder-801354-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 13:09:48.855382 dv-cinder-801354-9-smb devstack@keystone.service[81432]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 13:09:48 2022] *** Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: nodename: dv-cinder-801354-9-smb Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: machine: x86_64 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: clock source: unix Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: pcre jit disabled Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: detected number of CPU cores: 4 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: current working directory: / Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: detected binary path: /usr/bin/uwsgi-core Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: your processes number limit is 47680 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: your memory page size is 4096 bytes Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: detected max file descriptor number: 2048 Sep 09 13:09:48.857406 dv-cinder-801354-9-smb devstack@keystone.service[81432]: lock engine: pthread robust mutexes Sep 09 13:09:48.858100 dv-cinder-801354-9-smb devstack@keystone.service[81432]: thunder lock: enabled Sep 09 13:09:48.858100 dv-cinder-801354-9-smb devstack@keystone.service[81432]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 13:09:48.858100 dv-cinder-801354-9-smb devstack@keystone.service[81432]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 13:09:48.896962 dv-cinder-801354-9-smb devstack@keystone.service[81432]: Python main interpreter initialized at 0x55d3b9b939c0 Sep 09 13:09:48.896962 dv-cinder-801354-9-smb devstack@keystone.service[81432]: python threads support enabled Sep 09 13:09:48.896962 dv-cinder-801354-9-smb devstack@keystone.service[81432]: your server socket listen backlog is limited to 100 connections Sep 09 13:09:48.896962 dv-cinder-801354-9-smb devstack@keystone.service[81432]: your mercy for graceful operations on workers is 90 seconds Sep 09 13:09:48.897293 dv-cinder-801354-9-smb devstack@keystone.service[81432]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 13:09:48.897367 dv-cinder-801354-9-smb devstack@keystone.service[81432]: *** Operational MODE: preforking *** Sep 09 13:09:48.897638 dv-cinder-801354-9-smb devstack@keystone.service[81432]: *** uWSGI is running in multiple interpreter mode *** Sep 09 13:09:48.897638 dv-cinder-801354-9-smb devstack@keystone.service[81432]: spawned uWSGI master process (pid: 81432) Sep 09 13:09:48.897838 dv-cinder-801354-9-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 13:09:48.900835 dv-cinder-801354-9-smb devstack@keystone.service[81432]: spawned uWSGI worker 1 (pid: 81444, cores: 1) Sep 09 13:09:48.900835 dv-cinder-801354-9-smb devstack@keystone.service[81432]: spawned uWSGI worker 2 (pid: 81445, cores: 1) Sep 09 13:09:48.900835 dv-cinder-801354-9-smb devstack@keystone.service[81432]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 13:09:53.196872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:09:53.196872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: from cryptography.utils import int_from_bytes Sep 09 13:09:53.197637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:09:53.197637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: from cryptography.utils import int_from_bytes Sep 09 13:09:53.246770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:09:53.246950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:09:53.247134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] command line args: [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:09:53.247399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:09:53.247574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ================================================================================ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:09:53.247822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] admin_token = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.248061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_dir = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.248245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.248423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_source = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.248599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] debug = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.248794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.249938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.249938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.249938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.249938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_config_append = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_dir = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.250927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.251172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.251417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.251657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.251831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.252005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.252243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.252486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.252716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.253011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.253747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.253975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.254250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.254480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.254753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.255237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.255416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] publish_errors = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.255644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.255870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.256044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.256284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.256513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.256743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] standard_threads = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.256971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.257208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.257380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.257553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_journal = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.257724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_json = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.257895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_stderr = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.258067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_syslog = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.258323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.258576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.258811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.259064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.259298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.259540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.259773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.260014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.260251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.260494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.260736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.260982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.261212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.261454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.261685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.261925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.262166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.262421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.262690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.262920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.263161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.263393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.263642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.263898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.264145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.264389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.264618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.264846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.265074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.265305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.265549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.265790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.266017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.266263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.266509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.266751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.266983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.267228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.267458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.267690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.267920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.268146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.268373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.268809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.268996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.269195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.269443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.269667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.269901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.270135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.270401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.270635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.270880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.271108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.271341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.271574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.271807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.272038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.272270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.272496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.272741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.272973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.273205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.273432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.273686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.273920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.274150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.274408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.274640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.274904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.275141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.275384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.275626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.275859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.276092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.276323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.276568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.276802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.277035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.277275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.277508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.277751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.277983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.278230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.278467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.278697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.278929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.279184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.279423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.279665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.279900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.280141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.280380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.280613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.280845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.281076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.281302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.281529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.281754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.281985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.282273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.282466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.282697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.282941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.283172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.283423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.283676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.283912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.284161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.external = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.284402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.284703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.284924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.285135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.password = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.285359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.token = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.285591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.285822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.286064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.286317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.286560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.286800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.287028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.287260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.287501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.287744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.287988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.288227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.288465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.288697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.288939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.289186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.289419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.289669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.289951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.290193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.290475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.290714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.290965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.291196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.291431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.291673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.291916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.292144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.292389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.292625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.292874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.293109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.293356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.293589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.293831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.294064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.294333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.294577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.294809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.295041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.295284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.295512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.295746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.296241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.296492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.296722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.296950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.297178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.297418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.297661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.297902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.298151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.298421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.298684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.298919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.299160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.299389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.299621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.300373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.300607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.300845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.301082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.301327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.301552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.301795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.302038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.302292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.302535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.302780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.303019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.303238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.303464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.303695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.303929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.304165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.304397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.304744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.304992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.305237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.305467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.305695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.305941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.306185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.306442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.306676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.306911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.307141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.307379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.307634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.307862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.308106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.308350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.308591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.308824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.309051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.309283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.309515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.309748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.309975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.310235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.310481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.310722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.310963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.311203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.311428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.311670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.311903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.312136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.312370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.312602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.312842 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.313095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.313314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.313564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.313791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.314032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.314287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.314522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.314755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.314998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.315236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.315510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.316261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.316500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.316752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.316993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.317226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.317471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.317715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.317949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.318191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.318455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.318690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.318922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.319165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.319392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.319637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.319883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.320125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.320373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.320613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.320854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.321094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.321335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.321563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.321803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.322044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.322308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.322551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.322944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.323181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.323425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.323671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.323915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.324161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.324392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.324641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.324888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.325122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.325350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.325577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.325805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.326050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.326329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.326574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.326809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.327042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.327269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.327502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.327735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.327978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.328212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.328463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.328706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.328938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.329178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.329415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.329657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.329888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.330124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.330383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.330626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.330901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.331249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.331506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.331799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.332204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.332447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.332691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.332923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.333161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.333395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.333628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.333860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.334091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.334356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.334589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.334829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.335060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.335303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.335533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.335773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.336000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.336235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.336467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.336633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:09:53.336901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:09:53.336901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: from cryptography.utils import int_from_bytes Sep 09 13:09:53.337404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:09:53.337404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: from cryptography.utils import int_from_bytes Sep 09 13:09:53.366796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.367024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.367250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.375495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.385945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:09:53.386139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:09:53.386370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] command line args: [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:09:53.386641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:09:53.386818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ================================================================================ {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:09:53.387069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] admin_token = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.387313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] config_dir = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.387500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.387680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] config_source = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.387856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] debug = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.388064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.388293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.388468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.388714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.388959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.389187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.389364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_config_append = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.389539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.389718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_dir = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.389892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_file = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.390122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.390388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.390632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.390873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.391048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.391221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.391460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.391700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.391929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.392159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.392387 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.392615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.392856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.393096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.393370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.394099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.394482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] publish_errors = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.394740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.394974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.395156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.395404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.395642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.395879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] standard_threads = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.396113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.396356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.396533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.396709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] use_journal = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.396883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] use_json = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.397057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] use_stderr = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.397232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] use_syslog = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.397462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:09:53.397718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.397958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.398239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.398474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.398722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.398960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.399207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.399443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.399689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.399933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.400182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.400417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.400663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.400899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.401145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.401390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.401624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.401875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.402125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.402396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.402635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.402888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.403148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.403379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.403463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.403610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.403691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.403850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.404081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.404310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.404549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.404797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.405042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.405272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.405502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.405747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.405992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.406244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.406495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.406726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.406961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.407205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.407435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.407663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.407890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.408118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.408353 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.408599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.408828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.409062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.409943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.410432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.410719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.410972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.411206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.411443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.411680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.411918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.412154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.412390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.412920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.412920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.413150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.413389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.413620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.413877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.414114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.414372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.414609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.414847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.415113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.415352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.415598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.415842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.416076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.416309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.416543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.416789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.417025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.417261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.417502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.417738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.417981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.418240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.418465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.418698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.418933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.419166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.419421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.419660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.419902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.420139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.420374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.420614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.420849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.421337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.421569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.421797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.422025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.422274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.422509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.422736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.422973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.423206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.423452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.423684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.423936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.424193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.424428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.424655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.external = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.425508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.426040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.426392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.426631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.password = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.426866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] auth.token = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.427107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.427345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.427590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.427821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.428067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.428313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.428544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.428780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.429025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.429272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.429517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.429767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.430008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.430264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.430511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.430764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.431000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.431250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.431530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.431773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.432031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.432270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.432523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.432756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.432991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.433235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.433477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.433705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.433950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.434184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.434460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.434692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.434946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.435180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.435422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.435656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.435900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.436144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.436377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.436610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.436854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.437082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.437316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.437561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.437809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.438037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.438288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.438518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.438760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.439004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.439249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.439502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.439745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.440012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.440248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.440504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.440901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.441329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.441568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.441805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.442046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.442312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.442561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.442790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.443034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.443279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.443513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.443754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.443997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.444225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.444461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.444693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.444926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.445159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.445399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.445632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.445865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.446109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.446378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.446611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.446840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.447127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.447331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.447565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.447799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.448145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.448379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.448622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.448880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.449112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.449358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.449602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.449848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.450077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.450332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.450569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.450802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.451037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.451266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.451511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.451755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.451997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.452240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.452482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.452708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.452950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.453182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.453416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.453647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.453879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.454120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.454388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.454629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.454877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.455105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.455345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.455579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.455813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.456074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.456464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.456919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.457092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.457184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.457382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.457623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.457872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.458118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.458382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.458631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.458878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.459112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.459355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.459588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.459824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.460058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] role.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.460301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] role.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.460529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.460773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.461020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.461264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.461507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.461750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.461993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.462268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.462502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.462730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.462973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.463217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.463461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.463703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.464101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.464343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.464597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.464844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.465089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.465335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.465569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.465820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.466070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.466336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.466570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.466800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.467030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.467276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.467529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.467774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.468009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.468244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.468473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.468707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.468940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.469184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.469419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.469670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.469914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.470149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.470412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.470656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.470902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.471136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.471373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.471607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.472429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.472923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.473162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.473408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.473675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.473944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.connection = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.474188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.474459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.474696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.474938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.475180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.475415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.475649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.475885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.476130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.476367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.476610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.476845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.477091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.477324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.477565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.477792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.478031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.478286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:09:53.478448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:09:53.504258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.504490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.504716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.506086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.506356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.512942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.531174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.531406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.571476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.609010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.609273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.660123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.660525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.660749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.660966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.661180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.661392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.686627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.686856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.687082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.687308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.687528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.687740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.687951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.700137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.713529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.713759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.713982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.714202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.714449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.714664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.714878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.732337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.732543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 13:09:53.732888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.733089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 13:09:53.733368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.733629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.733889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.734145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.743849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.744081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.744306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.744461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.744545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.744732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.744814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.744947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.745032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.745269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.752222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.755294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.755581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.755862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.756143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.756426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.756687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.756957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.757229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.757499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.757773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.757891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.758040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.758130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.758356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.758581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.758798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.759010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.759220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.767032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.770842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.771068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.771287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.771502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.771714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.771924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.772139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81444) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 13:09:53.781058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.782109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.782345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 13:09:53.782545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.782683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.782828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.782911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 13:09:53.783141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.783404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.783664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.783928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.788203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.788490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.788781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.794271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.794552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.794830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.795114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.795210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.795398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.801493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.801791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.802082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.802389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.802667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.802861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.802943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.803198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.803472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.805824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.806117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.806426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.806714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.807006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.807269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.807539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.807818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.808097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.808372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.808640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.818930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.819214 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.823061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.826321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.826620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.830822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.832531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.834013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.834321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.834565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.837769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.838070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.838377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.838665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.838905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.838995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.839190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.839283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.839473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.845953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.846261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.851132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.851426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.851714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.851994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.852276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.854263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.854557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.854851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.855549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.855838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.856105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.856367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.863225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.864762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.866315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.866594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.870006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.870325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.870607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.870704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.870891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.870982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.871282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.874753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.877854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.878347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.882438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.882728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.882809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.883010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.883293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.883672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.883953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.884248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.885861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.889053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.889351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.889815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.890248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.890529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.890822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.900192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.903115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.905974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.907438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.907523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.907734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.908004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.908266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.908908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.909768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.910153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.915856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.916518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.917538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.917970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.919105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.919380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.920874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.921525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.921812 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.922090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.922281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.922581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.922870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.923152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.923436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.929924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.930237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.930525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.935283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.935571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.935852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.936138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.936425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.936701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.936983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.937857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.938142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.938456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.938730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.939016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.939287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.939557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.939830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.940094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.940374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.940677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.940939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.941316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.941628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.952713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.955720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.959620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.961053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.962535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.962818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.963107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.969600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.971077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.974956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.975261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.975548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.975832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.976911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d3b9b939c0 pid: 81445 (default app) Sep 09 13:09:53.980186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111a66-1bad-4168-9fa4-74c6d5078010 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:09:53.980473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111a66-1bad-4168-9fa4-74c6d5078010 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:09:53.980743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66111a66-1bad-4168-9fa4-74c6d5078010 None None] PATH_INFO: `/v3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:09:53.983762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.984056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.984338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.984862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Sep 9 13:09:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:09:53.991599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81444) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 13:09:53.991890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.992174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.992449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.992724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.993010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.993284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.993554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.993822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.994092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.994393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.994674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.994942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:53.995210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81444) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 13:09:54.030298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3b9b939c0 pid: 81444 (default app) Sep 09 13:10:00.792634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:00.793150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:00.793255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:00.794523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:00.802478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:00.803050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:00.803050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:00.872991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: INFO dbcounter [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] Registered counter for database keystone Sep 09 13:10:00.892837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG oslo_db.sqlalchemy.engines [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:10:00.899702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writer thread running {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:10:01.083335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG passlib.handlers.bcrypt [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81444) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 13:10:01.083655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG passlib.handlers.bcrypt [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81444) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 13:10:01.141322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:01.142959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:01.270301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 13:10:01.729380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:01.799605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: INFO dbcounter [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] Registered counter for database keystone Sep 09 13:10:01.821293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG oslo_db.sqlalchemy.engines [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:10:01.827733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writer thread running {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:10:01.954355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136cb08-f2ca-4dd3-9ea2-e1069dc4205e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:01.959341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:01.959973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:01.960255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:01.960528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:01.973874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:02.027188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING keystone.common.rbac_enforcer.enforcer [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 13:10:02.027543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b7fbe-cbb6-4e65-a85e-defbc904f307 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:02.037572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Sep 9 13:10:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:10:02.043543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:02.061072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43d5cb-5674-46b3-9b4b-dd1933879a59 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:02.066042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:02.067324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:02.067609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:02.067885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] PATH_INFO: `/v3/projects/7416d42f68304327bdde9d1c2d38a108` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:02.069326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] RBAC: Authorizing `identity:get_project(project_id=7416d42f68304327bdde9d1c2d38a108)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:02.121963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 13:10:02.122330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c827e-386a-4ce0-b1c9-1429a53b289e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:02.126872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Sep 9 13:10:02 2022] GET /identity/v3/projects/7416d42f68304327bdde9d1c2d38a108 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:04.257351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37690-72f2-4a80-9564-38660a516fad None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:04.257850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37690-72f2-4a80-9564-38660a516fad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:04.257956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a37690-72f2-4a80-9564-38660a516fad None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:04.262002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:04.267626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:04.268022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:04.268182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:04.288921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:04.290460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:04.298462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 13:10:04.564828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37690-72f2-4a80-9564-38660a516fad None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:04.576939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a37690-72f2-4a80-9564-38660a516fad None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:04.581682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:04.582356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:04.582637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:04.582906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:04.590531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:04.592298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74260-06f1-4d6e-a063-5af1978e88b1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:04.601540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Sep 9 13:10:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:10:04.607026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:04.616185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010facde-42e0-43a9-b148-ea28cc255581 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:04.620585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:04.621210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:04.621494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:04.621771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:04.623110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:04.624931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a5be9-12da-4a7f-9207-b9c119f4b47d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:04.626487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Sep 9 13:10:04 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:06.830805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff438-0322-4fe1-9441-de40bca420cf None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:06.831945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff438-0322-4fe1-9441-de40bca420cf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:06.831945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ff438-0322-4fe1-9441-de40bca420cf None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:06.833207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:06.838454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:06.838888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:06.839119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:06.857549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:06.858754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:06.894129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacbddf-301b-4807-bed8-d3a94a76a5a2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:06.894129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacbddf-301b-4807-bed8-d3a94a76a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:06.894129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacbddf-301b-4807-bed8-d3a94a76a5a2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:06.895976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:06.901173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:06.901565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:06.901843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:06.941394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:06.944678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG passlib.handlers.bcrypt [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81445) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 13:10:06.945080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG passlib.handlers.bcrypt [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81445) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 13:10:06.994100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:06.995709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:07.094822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:07.209694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.234432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.314835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc056f-4222-4aac-9eb9-c4e4e9e11eb2 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.348420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.348986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.349270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.349543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.358931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.360756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:07.370185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:07.371255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:07.372076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:07.377053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.457983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.460329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90226f1-42ac-4812-b8c7-a6cf6c36e242 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.462644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.476121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21bba7-abb8-4ec8-8074-59b48f75f042 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.499241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.500100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.500377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.500647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.510728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.511335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.511621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.511894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.512561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:07.512865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.514270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.525965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 7/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:07.531832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.568052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.569558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.631416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed34c2-21f7-43f9-87d2-020e576a4048 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.664342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.664962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.665242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.665510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.666663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.667221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:07.668111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.674109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:07.674272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.675687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.676885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.690380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.773540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5807-35c9-4e6a-9039-290448337c99 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.773748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e1c60-eb81-4562-a468-617c294d3e52 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.807435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.808113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.808398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.808672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.808779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.809570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.809786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.809872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.810107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.811255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.814581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:07.818887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.832159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.833762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:10:07.853880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:07.854865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:10:07.855658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:10:07.855658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:10:07.855658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:07.855658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:07.860834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:07.898501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.916918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:07.919429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f39dd9-8001-40a8-bbba-2fcb78f54361 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:07.954543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:07.955152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:07.955436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:07.955717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:07.957074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.domain.id=default, user.id=6ec940c1a9a046a9adaf049147f74a4b) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:07.957381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:07.958882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a443e7d-108d-4ecc-b646-c05914957495 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:07.966273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/role_assignments?user.id=6ec940c1a9a046a9adaf049147f74a4b&scope.domain.id=default&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:07.970510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5d8f2-2b22-4083-84b9-00fafc45bbab None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:08.006785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:08.007429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:08.007704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:08.007982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:08.008631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:08.008929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:08.010339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47652fc-4eeb-485a-930e-7ddd8f61f517 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:08.029197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:10.459992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13e27-4186-455e-ae52-7aa7aa48e114 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:10.460527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13e27-4186-455e-ae52-7aa7aa48e114 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:10.460527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f13e27-4186-455e-ae52-7aa7aa48e114 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:10.461385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c086ae-98cb-4dfa-9069-4edde9af4d79 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:10.461847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:10.462367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c086ae-98cb-4dfa-9069-4edde9af4d79 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:10.462851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c086ae-98cb-4dfa-9069-4edde9af4d79 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:10.464359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:10.469666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ca79-c60b-4fd9-8fba-49173d26efe6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:10.469950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ca79-c60b-4fd9-8fba-49173d26efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:10.470251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537ca79-c60b-4fd9-8fba-49173d26efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:10.470546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff130b-a192-46c9-b99c-0ca230fbda90 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:10.471019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff130b-a192-46c9-b99c-0ca230fbda90 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:10.471544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff130b-a192-46c9-b99c-0ca230fbda90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:10.492572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c9ff130b-a192-46c9-b99c-0ca230fbda90 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:10.494649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c9ff130b-a192-46c9-b99c-0ca230fbda90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:10.509016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d537ca79-c60b-4fd9-8fba-49173d26efe6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:10.510372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d537ca79-c60b-4fd9-8fba-49173d26efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:10.630642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:10.649029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:11.028908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd9ba-8067-41fc-83a2-7416e9827202 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.029589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd9ba-8067-41fc-83a2-7416e9827202 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.030091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cd9ba-8067-41fc-83a2-7416e9827202 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.031694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:11.037907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.038447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.038899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.067524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:11.069068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:11.108382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cd9ba-8067-41fc-83a2-7416e9827202 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.185457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:11.204487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:11.207618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.216365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:11.281484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cd9ba-8067-41fc-83a2-7416e9827202 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:11.349538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:11.351145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.351617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.352076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.369604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:11.371803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:10:11.397405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:11.398301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:10:11.399077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:10:11.399077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:10:11.399077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:11.401474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 15/28] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:11.408325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.531796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6ff18-a204-4a45-9663-08f10f6d774b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:11.573569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:11.580360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1813-580b-4cb9-9414-a7c54fc6c1cb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:11.598020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:11.598691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.598973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.600440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.617279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f426fdce-66c2-4698-8ea6-d660ad23af36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:11.623360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:11.624183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:11.624913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:11.627440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:11.629811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:11.630268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec6d6-5467-4583-8910-90cc3095f5df None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.630458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.630739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.631016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.631339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec6d6-5467-4583-8910-90cc3095f5df None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.631670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:11.631982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:11.632222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ec6d6-5467-4583-8910-90cc3095f5df None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.633458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:11.633918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:11.638931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ec6d6-5467-4583-8910-90cc3095f5df None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.646368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:11.647289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.712926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:11.756844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ec6d6-5467-4583-8910-90cc3095f5df None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:11.757336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bbfe2-4e1a-4095-98c5-a0f4a2c7bf82 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:11.794660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:11.795243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:11.795712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.796045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.796303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.796767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.797130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.797234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.797975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:11.798263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:11.798734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:11.799643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:11.800504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfeabc-0a50-4165-a0b8-dbfbb43503b9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:11.815183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:11.817208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:11.817593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:11.817981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:11.837106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:11.838468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:11.854027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:11.910365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 18/33] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:11.911372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:11.951606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 16/34] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Sep 9 13:10:11 2022] POST /identity/v3/roles => generated 219 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:11.952965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.022810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c8021-48da-418f-a283-0d71c76329cb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.062810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.063825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.064078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.064449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.065491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.072357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffe8ac-2ad5-4752-ab16-012bacfdd30d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.088097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f7c0a-f183-4796-ace5-349850de0c6a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.146737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:12.172722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.173653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.174106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.174558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.176292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.178192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.185018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:11 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:12.190860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.266612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:10:11 2022] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:12.308747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dacde-6a5a-46a5-b6ad-9f87af14401f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.309041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dacde-6a5a-46a5-b6ad-9f87af14401f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.309318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dacde-6a5a-46a5-b6ad-9f87af14401f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.310745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 20/37] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:12.318108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.318421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.318704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.325700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:12.341337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:12.343228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:12.355686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e7f6-12f1-4bae-9fd9-55ed4c56e17d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.402435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.403224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.403508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.403785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.406081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.407687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730c74-1af4-4e97-811c-a6fbe0de4f34 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.409949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 18/38] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:12.411439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5de0b-aece-4b11-8643-e8ffadaf496d None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.411743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5de0b-aece-4b11-8643-e8ffadaf496d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.412001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5de0b-aece-4b11-8643-e8ffadaf496d None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.413374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 19/39] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:12.423109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.423299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.423557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.438811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:12.440128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.457534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:12.459228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:12.571310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3af50-d0ab-4e3b-824e-6d79dd734635 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.607604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:12.614848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.616044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.616044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.616251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] PATH_INFO: `/v3/domains/default/users/6ec940c1a9a046a9adaf049147f74a4b/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.618623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6ec940c1a9a046a9adaf049147f74a4b, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.619889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.634011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:12.642420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 22/41] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Sep 9 13:10:12 2022] PUT /identity/v3/domains/default/users/6ec940c1a9a046a9adaf049147f74a4b/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:12.642420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.658159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 20/42] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:12.727646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.770989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce429-8c49-4686-8bde-969dab96887a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.825751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.828981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.828981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.828981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.829474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.831580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.852628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 23/43] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Sep 9 13:10:12 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:12.868110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760584e-afe5-41df-86ca-12066ce4dc80 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:12.910337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:12.911048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:12.911377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:12.911652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:12.912997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:12.914683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:12.916857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 21/44] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:12.922973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.953465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:12.995433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:13.022456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:13.068533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016a0a-3728-49e2-ab67-5bf2dcd78770 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:13.074677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cfdd1-7a43-44e1-8afc-4fddaa86b185 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:13.114972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:13.115546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:13.115670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:13.115865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:13.116149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:13.116852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:13.116951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:13.117405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:13.117864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:13.118284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be16e9-91b2-4746-a94e-83e8fa2c0f00 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:13.119554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:13.121156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b215e3-b5cc-482d-b657-d3175d7fa739 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:13.136720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Sep 9 13:10:12 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:10:13.152286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:10:12 2022] POST /identity/v3/projects => generated 312 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:14.874296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e966-d7b8-43c2-b9ef-77f432ca64d6 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:14.874796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e966-d7b8-43c2-b9ef-77f432ca64d6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:14.874879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e966-d7b8-43c2-b9ef-77f432ca64d6 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:14.876182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:14.881426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b8dc-6840-4e11-9c2a-f53248da2c6f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:14.881847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b8dc-6840-4e11-9c2a-f53248da2c6f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:14.881985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b8dc-6840-4e11-9c2a-f53248da2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:14.900327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-dfa6b8dc-6840-4e11-9c2a-f53248da2c6f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:14.901511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dfa6b8dc-6840-4e11-9c2a-f53248da2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:14.968341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:15.233997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e966-d7b8-43c2-b9ef-77f432ca64d6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.337082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e966-d7b8-43c2-b9ef-77f432ca64d6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.355250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:15.359553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78c69-de5c-44cd-90be-2b5f0cada07c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.359845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78c69-de5c-44cd-90be-2b5f0cada07c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.360160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e78c69-de5c-44cd-90be-2b5f0cada07c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.361652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 26/49] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:15.367361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.367726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.368070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.373625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.374461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.374748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.375027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.386314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:15.386464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:15.387506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:15.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:15.392232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:15.393288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 24/50] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:15.398011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.415922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:15.458098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 27/51] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:15.498371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a04a5-1170-47b6-a1b0-1eabca3a6647 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.531186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.531790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.532076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.532356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.533017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:15.533325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:15.535559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:15.543515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 25/52] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:15.549474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.646319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ac12-f65b-4f90-90fd-376fdffafb1e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.679915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.680552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.680838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.681115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.682255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:15.683689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:15.685244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 28/53] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:15.690778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.724063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.733040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:15.754826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:15.793909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca071e7-6bf4-407a-b724-7e8fcaf9d747 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.834202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.834881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.835167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.835443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.836616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:15.838084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:15.839732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:15.845693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.929953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6c09-e9e3-4bc0-903b-ec7af0f66fc9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.945962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cded6d-6403-4b04-920d-23f76accb132 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:15.954821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:15.962613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.963245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.963523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.963803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.964899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:15.966357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:15.967900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 29/55] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:15.974198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:15.981855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:15.982900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:15.983192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:15.983467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:15.984193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.domain.id=default, user.id=6ec940c1a9a046a9adaf049147f74a4b) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:15.984503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:15.985936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953ce79-c74c-4aa1-b467-20bf8c7e47ae None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:15.992882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 27/56] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Sep 9 13:10:15 2022] GET /identity/v3/role_assignments?user.id=6ec940c1a9a046a9adaf049147f74a4b&scope.domain.id=default&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:16.080339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:16.083927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294322-8c88-484d-aeb1-1ad360502e76 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:16.121973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:16.122628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:16.122909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:16.123178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:16.123840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:16.125290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a2be5-0531-4550-8682-d5e2e56e7060 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:16.154566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Sep 9 13:10:15 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:10:18.288123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac47c7-3c9c-4fd8-a7e0-006b654bd2a0 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:18.288651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac47c7-3c9c-4fd8-a7e0-006b654bd2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:18.288651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac47c7-3c9c-4fd8-a7e0-006b654bd2a0 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:18.290012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 28/58] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:18.295234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:18.295611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:18.295821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:18.313706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:18.314946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:18.379263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:18.651582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac47c7-3c9c-4fd8-a7e0-006b654bd2a0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:18.752410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac47c7-3c9c-4fd8-a7e0-006b654bd2a0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:18.784996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:18.785615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:18.785901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:18.786179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:18.787326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:18.788769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9188-a904-488d-9348-6e8a45bb4e65 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:18.790339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 29/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:18.795717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:18.876021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:18.894101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59712dcc-72fc-491f-bb94-2694b8810900 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:18.927241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:18.927783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:18.928061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:18.928331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:18.928973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:18.930425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef4bc1-2ed6-442c-9d32-5d1137729c23 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:18.955236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:18 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:22.222289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04122f7-0687-427b-ac68-a402cbdbe9bf None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.223507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04122f7-0687-427b-ac68-a402cbdbe9bf None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.224033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04122f7-0687-427b-ac68-a402cbdbe9bf None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.225586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 30/62] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:22.230909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2536-607b-4b36-84f2-eb9540e40c91 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.231716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2536-607b-4b36-84f2-eb9540e40c91 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.232192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa2536-607b-4b36-84f2-eb9540e40c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.251591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-02aa2536-607b-4b36-84f2-eb9540e40c91 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:22.253265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-02aa2536-607b-4b36-84f2-eb9540e40c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:22.343816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:22.404846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f520-3d13-4b3f-b5c5-4e3d2d3705a9 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.405465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f520-3d13-4b3f-b5c5-4e3d2d3705a9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.406011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f520-3d13-4b3f-b5c5-4e3d2d3705a9 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.407579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:22.413157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b692c-8567-4cfd-b1c6-72efa221726f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.413682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b692c-8567-4cfd-b1c6-72efa221726f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.414149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b692c-8567-4cfd-b1c6-72efa221726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.443270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-173b692c-8567-4cfd-b1c6-72efa221726f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:22.444840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-173b692c-8567-4cfd-b1c6-72efa221726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:22.526574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:22.536281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:22.650323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f520-3d13-4b3f-b5c5-4e3d2d3705a9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:22.713469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:22.783337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f7a-b6e8-454d-af1d-880e991142f0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.784469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f7a-b6e8-454d-af1d-880e991142f0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.784945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35f7a-b6e8-454d-af1d-880e991142f0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.786522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 35/66] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:22.791640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0ee5-c3fb-4cd5-b846-4d11f7e6467b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.792033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0ee5-c3fb-4cd5-b846-4d11f7e6467b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.792536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0ee5-c3fb-4cd5-b846-4d11f7e6467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.795411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f520-3d13-4b3f-b5c5-4e3d2d3705a9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:22.823166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-789e0ee5-c3fb-4cd5-b846-4d11f7e6467b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:22.824361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-789e0ee5-c3fb-4cd5-b846-4d11f7e6467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:22.858595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:22.860153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.860616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.861323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.873150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4a1feace-8b2d-444d-a74f-396d85fa2ad9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:22.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:22.879315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:22.880047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 32/67] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:22.881468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534501-ab02-44fa-9f4f-83701569cc73 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.881468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534501-ab02-44fa-9f4f-83701569cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.881468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34534501-ab02-44fa-9f4f-83701569cc73 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.882627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 33/68] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:22.886360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1162-e2e8-44a8-b995-75c5761bbf6b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.886360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1162-e2e8-44a8-b995-75c5761bbf6b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.886360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1162-e2e8-44a8-b995-75c5761bbf6b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.886360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 34/69] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:22.887903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1162-e2e8-44a8-b995-75c5761bbf6b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:22.912588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 36/70] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:22.914028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce675-d107-481d-b9ad-6a10fa3b5006 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:22.914479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce675-d107-481d-b9ad-6a10fa3b5006 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:22.914894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce675-d107-481d-b9ad-6a10fa3b5006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:22.945926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b09ce675-d107-481d-b9ad-6a10fa3b5006 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:22.947373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b09ce675-d107-481d-b9ad-6a10fa3b5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:22.999424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.004794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a1162-e2e8-44a8-b995-75c5761bbf6b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.024022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 37/71] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:23.025284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.025581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.025863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.046271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:23.046576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.047604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.047784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:23.048182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.048587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.049389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:23.050755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.053205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.069400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 35/72] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.069400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.112413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.128672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 38/73] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:23.129694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.207653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db1ed0-9ad3-41bb-8ae1-3c3bc22e9243 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.236718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7685-91d6-46fa-a727-2cea5156ed5f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.261181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.262475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.262951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.263456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.278414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:23.284870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.285721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:23.285899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:23.286836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:23.287577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 36/74] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:23.288691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.289086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.289466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.305657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.307229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.308962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 39/75] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.313361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.320599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.362377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.400957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826d751-6948-4882-85fb-5d837bd878c2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.419488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538390-2878-446c-bd8e-bca980cb7679 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.439173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.440007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.440988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.441428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.452040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:23.456847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.457455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.457738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:23.457897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:23.458714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:23.459466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:23.460086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.460086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:23.460086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.460246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:23.460246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.460364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.469271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 40/77] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.470088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.545203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.563865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca47a-ae47-4f78-b63b-5a647c4f2b82 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.569190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946600-e6bb-43fd-942b-59aaf62f9539 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.578062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.599039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.599668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.599947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.600226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.604127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.604738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.605021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.605297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.610477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:23.615552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:23.616434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:23.617176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 38/78] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:23.617785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.676133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.677599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.718061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efa0c7-d521-42e5-acba-d6df27c13d6e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.760581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.761183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.761469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.761741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.762431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:23.762739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.764127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.772952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.778423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:23.778559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.778646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.781346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.787356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.875714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb3cf-877b-4c3f-9f13-50478055c2a0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.884703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a9987-5118-47c4-af68-bdd232b929b2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:23.908918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.910145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.910460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.910737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.911880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.913331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.915017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 42/81] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.918188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:23.918838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:23.919116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:23.919423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:23.920470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.920594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:23.922207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:23.923774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 40/82] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:23.924548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:23.993576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:23.999381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.024016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d27e-1dda-4a22-be31-262552cfde36 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.024588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f1b2e-13a0-4377-b40a-5b72fc570119 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.057454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002928d7-c798-4b3e-b479-db023255695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.058082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002928d7-c798-4b3e-b479-db023255695d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.058395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002928d7-c798-4b3e-b479-db023255695d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.058666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002928d7-c798-4b3e-b479-db023255695d None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.059799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002928d7-c798-4b3e-b479-db023255695d None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.061245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002928d7-c798-4b3e-b479-db023255695d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.061475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.062087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.062403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.062682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.062851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 41/83] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.063608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002928d7-c798-4b3e-b479-db023255695d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.063703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:24.064079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.066010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.075208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 43/84] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.077093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.164608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002928d7-c798-4b3e-b479-db023255695d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.177581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33028a62-2119-49d2-9a96-4d8d66a801b2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.197896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.198546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.198834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.199105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.200236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.201687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.203342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 42/85] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.204082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.210875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.211498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.211783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.212055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.215369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.222188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.281092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.282591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.305606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a33dc-ca5e-4788-83f9-b60dd0dba4f5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.338946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.339541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.339819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.340097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.340736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.342176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.369431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 43/86] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:24 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:24.370291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.382910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 44/87] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:24.382910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.438395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.458236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.502501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318b0ab-aa45-42d3-b03f-4f0a7c386add None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.514243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d55809-fde1-424f-a9fa-b26b774051c4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.540567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.541190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.541473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.541744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.554635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.555288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.555573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.555853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.557000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.558965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.560295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 45/88] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.560886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.623466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.624971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.682041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3acf49-01f6-4d2e-a5f0-5fe8d75780e1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.692701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.708392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:24.727178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.728060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.728773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.729060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.729815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:24.730134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.731611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.742069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 46/89] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.742623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.768408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 44/90] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:24.769343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.881638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0456a5-ecae-4388-8a01-de90d2cc8306 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.919652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f59b4-38d9-4efd-9c43-746c7ea652bd None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:24.935542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.936450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.936879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.937322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:24.938657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:24.940860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:24.943057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 47/91] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:24.950242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:24.966600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:24.967239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:24.967525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:24.967802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.020001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.030322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.074270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.076575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.132527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b6213-b9d3-4942-9f56-5173a78e045f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:25.197879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:25.198571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:25.199134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:25.199288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.203028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.204613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.206276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 45/92] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:25.207450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:25.211419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 48/93] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:24 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:25.212098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:25.286596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.330658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259b0bb-a890-4c90-9e0e-0f2fb04e9e98 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:25.386000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:25.387040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:25.387523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:25.387993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.388918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=6ec940c1a9a046a9adaf049147f74a4b) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:25.389446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.391135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.403985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 46/94] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:25 2022] GET /identity/v3/role_assignments?user.id=6ec940c1a9a046a9adaf049147f74a4b&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:25.407264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:25.416804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cbd5d-1d68-458a-b671-d4d2dcbe2aee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:25.437487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.496963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:25.497641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:25.497919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:25.498192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] PATH_INFO: `/v3/projects/e1ad9f4485474d749ee4365f3d70c84f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.503408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] RBAC: Authorizing `identity:get_project(project_id=e1ad9f4485474d749ee4365f3d70c84f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.505049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.506881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 49/95] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:25 2022] GET /identity/v3/projects/e1ad9f4485474d749ee4365f3d70c84f => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:25.514179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:25.625412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af00c4-7161-4a18-9051-7929ade04e07 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:25.666241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:25.680294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:25.681256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:25.681743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:25.682258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.683197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:25.683749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.685408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f57f81-c0a9-4d02-8504-bc5f51422143 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.700098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 47/96] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:25 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:25.742147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59b12-d9fb-4927-9747-6a4eadc4b775 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:25.786414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:25.786984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:25.787271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:25.787547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:25.788337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=e1ad9f4485474d749ee4365f3d70c84f, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:25.788677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:25.790187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88c49d-9d4a-4d80-8ff8-92215d8b6b50 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:25.801486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 50/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:25 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=e1ad9f4485474d749ee4365f3d70c84f&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:27.394309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8005e-d282-4e76-bb85-93f0b25edea0 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.395369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8005e-d282-4e76-bb85-93f0b25edea0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.395862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8005e-d282-4e76-bb85-93f0b25edea0 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.397410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 48/98] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:27.403323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b10e5-9d59-4164-8e43-008e01e9ef69 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.404243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b10e5-9d59-4164-8e43-008e01e9ef69 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.404769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b10e5-9d59-4164-8e43-008e01e9ef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.426885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7d3b10e5-9d59-4164-8e43-008e01e9ef69 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:27.428431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7d3b10e5-9d59-4164-8e43-008e01e9ef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:27.468351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:27.516149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 51/99] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:27.612871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62551ce-7161-4730-bb98-5d1211181ab9 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.613210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62551ce-7161-4730-bb98-5d1211181ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.613465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62551ce-7161-4730-bb98-5d1211181ab9 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.614877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 49/100] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:27.622514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28e85-c36b-4382-99b2-d1af5e578579 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.622808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28e85-c36b-4382-99b2-d1af5e578579 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.623088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28e85-c36b-4382-99b2-d1af5e578579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.643845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-69b28e85-c36b-4382-99b2-d1af5e578579 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:27.645156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-69b28e85-c36b-4382-99b2-d1af5e578579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:27.715011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:27.733985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad885-0700-4be8-854f-43f602b8501b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.734311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad885-0700-4be8-854f-43f602b8501b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.734597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ad885-0700-4be8-854f-43f602b8501b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.736011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 50/102] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:27.741799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:27.742099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:27.742427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:27.767273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:27.768552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:27.861875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 53/103] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:27.992923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad885-0700-4be8-854f-43f602b8501b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.121609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.123184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ad885-0700-4be8-854f-43f602b8501b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.161845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.162931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.163488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.163985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.175003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:28.176177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:28.181445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:28.182312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:28.183047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:28.185332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 51/104] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:28.199022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.283667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:28.334794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8217d5-f5f2-4e8b-80a3-b52c5dbeadbd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.356950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288631ef-c67b-435f-90af-f22b69585196 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.406137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.409010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.409574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.410053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.413141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:28.415118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:28.419933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 54/105] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:28.426884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.432091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.432727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.433015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.433296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.433973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:28.434516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:28.436837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:28.455650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 52/106] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:28.456527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.602703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:28.616427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7a68-d7d9-475e-a922-6e7210251dc5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.626496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab41513-a72b-468e-abac-d8b2c6a4865c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.642588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:28.667784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.668536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.668836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.669112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.669847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:28.671400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e75ae-85c1-4ccc-bfc9-3c6bee52c053 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:28.687460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.688141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.688442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.688724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.708669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:28.716417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:28.717276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:28.718038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 55/107] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:28.718774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.723895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 53/108] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:10:28 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:28.725566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90256-07e1-46f7-9a95-980210cbedec None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.726098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90256-07e1-46f7-9a95-980210cbedec None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.726613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90256-07e1-46f7-9a95-980210cbedec None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.728196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 54/109] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:28.734203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90256-07e1-46f7-9a95-980210cbedec None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.878645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578278b-8c5b-4706-ab02-e62e40852b51 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.900102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc90256-07e1-46f7-9a95-980210cbedec None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:28.918029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.918878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.919256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.919631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] PATH_INFO: `/v3/users/b0f4c1ccc004436d9a059bea376d2c92` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.940172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] RBAC: Authorizing `identity:get_user(user_id=b0f4c1ccc004436d9a059bea376d2c92)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:28.942523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584af89-81a2-4109-848a-1c7ea286a94b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:28.949210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:28.949643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 56/110] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/users/b0f4c1ccc004436d9a059bea376d2c92 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:28.949830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.950107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.950419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.951216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:28.951383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.951473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:28.951730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.952153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.953320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05f472-29e5-492b-b461-8fb23e74b49f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:28.964337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 55/111] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:28.965664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729256-f857-472e-b788-5e88d28727e4 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:28.965961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729256-f857-472e-b788-5e88d28727e4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:28.966268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729256-f857-472e-b788-5e88d28727e4 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:28.967780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 56/112] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:28.968344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41729256-f857-472e-b788-5e88d28727e4 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:28.980157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:28.981751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:28.995185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.008087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.066802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 57/113] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:29.070314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.152873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41729256-f857-472e-b788-5e88d28727e4 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.218583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.219521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.219941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.220431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.254673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3f577-a251-42ca-8dd3-ca5a63494d34 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.324777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.325690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.326109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.326544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.327840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.329472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb72cf-ecef-44a0-bc15-76e231536dd9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.333028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 58/114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:29.334513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.334966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.335410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.339871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.340374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e5ec5-6aa3-4362-84f4-ae8364fab332 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.358318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:29.359833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:29.386507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.395332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.443618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 59/115] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:29.445276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.483930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 57/116] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:29.483930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e08455-025f-4d4b-8b6a-5f13832c6e1c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.483930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e08455-025f-4d4b-8b6a-5f13832c6e1c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.483930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e08455-025f-4d4b-8b6a-5f13832c6e1c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.483930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 58/117] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:29.484644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e08455-025f-4d4b-8b6a-5f13832c6e1c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.573133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afc71b-ca81-403e-931a-a5a48d91d7cb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.610117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.611210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.611738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.612287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.613624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.615475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.615829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e08455-025f-4d4b-8b6a-5f13832c6e1c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.617734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 60/118] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:29.619024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.633601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.653112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.667471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.668173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.668465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.668744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.684084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-413d4102-6859-4211-96a7-635ae03123c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:29.691101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:29.691956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:29.692682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:29.695549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 59/119] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:29.699378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.699730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.700020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.722975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:29.724601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:29.739776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82017a36-3b82-4cbc-8f10-cf5be89a4e9d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.776622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.777519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.777800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.778075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.779256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.780693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.782346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 61/120] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:29.783383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.810997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 60/121] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:29.811867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.889735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.915769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643022-1035-49d9-a6b6-7a8c86a7fdc5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.929394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e491a1-097c-414d-b587-63e483ab45e5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:29.949388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:29.957464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.958580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.958863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.959140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/users/bc3984f67b124d15a4a2d085a72ab521/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.961451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, user_id=bc3984f67b124d15a4a2d085a72ab521, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.963075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.971111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:29.972984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:29.973489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:29.973974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:29.974876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:29.975375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:29.977128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:29.978794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 62/122] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:29 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/users/bc3984f67b124d15a4a2d085a72ab521/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:29.979626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:29.989851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 61/123] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:29.991162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.120389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0dd55-20f2-450a-bb9a-0992068008ee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.162586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.163254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.163563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.164120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.168615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831a213-de8d-4fe9-bd70-1061a17755f5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.173269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:30.178408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:30.184774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:30.185752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:30.186551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 63/124] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:30.194104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.219204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.219204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.219765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.220027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.220761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=b0f4c1ccc004436d9a059bea376d2c92) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:30.221625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:30.225180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:30.234327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 62/125] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:29 2022] GET /identity/v3/role_assignments?user.id=b0f4c1ccc004436d9a059bea376d2c92&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:30.235301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.307239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:30.340730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716bf05-8f4f-4a14-a934-4736176de6b3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.385622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.386490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.386776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.387054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.389183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:30.390693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:30.391108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b27f3-7600-472f-9c70-3c954174f0bc None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.392306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 64/126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:30.393358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.451290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.452397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.454037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.457063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.487789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:30.493086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:30.493928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:30.494741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:30.502743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:30.503737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.504008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:30.550345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f545-10ac-4087-804c-ff852e0ebe3d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.597603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.598728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.599206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.599670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.600534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:30.601029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:30.602641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:30.619782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 65/128] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:30.620947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.712460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b44acc-6653-44ac-b1ab-f3e99737b016 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.716116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:30.780899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.781884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.782381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.783908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.785530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:30.788643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:30.791276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:30.792913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.804891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976d63e-97b4-4c35-891b-d26f4d97ced0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:30.874576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:30.886976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:30.887778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:30.888070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:30.888353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:30.889159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:30.889575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:30.891000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:30.907386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 66/130] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:30.908215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:30.988452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132974b-2268-4f2d-9be4-94ab790b78b7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.064470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.065035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.066004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.066413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.067628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.069082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.070689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 65/131] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:30 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:31.071203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de9e86-81d6-4375-96b6-9e4c8c88a3c6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.071449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:31.115526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:31.124758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.125436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.125718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.125996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/users/bc3984f67b124d15a4a2d085a72ab521/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.134712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, user_id=bc3984f67b124d15a4a2d085a72ab521, role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.136180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.160475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 67/132] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:30 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/users/bc3984f67b124d15a4a2d085a72ab521/roles/ee3812bbf20246aeb58841361e74fe32 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:31.162731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:31.253744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c55ff-af18-4688-aaa9-5541a3817444 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.260068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:31.326242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.326836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.327120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.327396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.328917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.330460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.334726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 66/133] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:31 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:31.341675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:31.365709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda9edf-6109-4d9b-8633-c06975634aa2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.449557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.450752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.452047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.452517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.455220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.456920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.459604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 68/134] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:31 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:31.469443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:31.575283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff250410-a7c7-4f22-9502-de051f621b16 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.585535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:31.593722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31579-86e5-4994-a4a9-5515b459014f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.613575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.614209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:31.615592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.616109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.616562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] PATH_INFO: `/v3/projects/e1ad9f4485474d749ee4365f3d70c84f` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.618012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] RBAC: Authorizing `identity:get_project(project_id=e1ad9f4485474d749ee4365f3d70c84f)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.620601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79198f5e-f08f-43cc-a7d6-7781632cce78 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.622499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 67/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:31 2022] GET /identity/v3/projects/e1ad9f4485474d749ee4365f3d70c84f => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:31.623970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147510-e456-4a2d-ab7f-019bf5af97a8 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.624441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147510-e456-4a2d-ab7f-019bf5af97a8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.624893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b147510-e456-4a2d-ab7f-019bf5af97a8 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.626538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 68/136] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:31.628277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b147510-e456-4a2d-ab7f-019bf5af97a8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:31.640120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.641088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.642555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.644236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/users/6ec940c1a9a046a9adaf049147f74a4b/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.648518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, user_id=6ec940c1a9a046a9adaf049147f74a4b, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.653035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24befce0-409a-48c1-9f42-0b95f8041982 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.675948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 69/137] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:31 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/users/6ec940c1a9a046a9adaf049147f74a4b/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:31.678156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.679670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.680420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.719493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:31.723112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:31.846280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b147510-e456-4a2d-ab7f-019bf5af97a8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:31.856076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:31.909324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:31.910075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:31.910382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:31.910659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] PATH_INFO: `/v3/projects/e1ad9f4485474d749ee4365f3d70c84f/users/bc3984f67b124d15a4a2d085a72ab521/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:31.912573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1ad9f4485474d749ee4365f3d70c84f, user_id=bc3984f67b124d15a4a2d085a72ab521, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:31.914103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:31.939100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:31 2022] PUT /identity/v3/projects/e1ad9f4485474d749ee4365f3d70c84f/users/bc3984f67b124d15a4a2d085a72ab521/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:32.249194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:32.363814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a289d-a8f4-4357-90a6-a265d022fbd9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:32.375551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:32.410261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:32.411265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:32.411798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:32.412301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:32.416955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:32.418796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d2da5-707c-4d29-afd5-070c792e3651 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:32.420971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:32.426364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:32.468415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:32.550959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02b511-2ba8-4ee9-a39d-a661bb5eea09 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:32.597429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:32.598909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:32.599448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:32.599991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:32.600880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:32.602759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87de77c-b3fb-4c2d-94b2-38506e72a1ff None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:32.634020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 70/141] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:32 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:32.689408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad34e3-13b7-4f2d-8966-4c5c7b1ffaf7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:32.691108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad34e3-13b7-4f2d-8966-4c5c7b1ffaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:32.691650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad34e3-13b7-4f2d-8966-4c5c7b1ffaf7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:32.693290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 72/142] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:32.702856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:32.703156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:32.703425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:32.727955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:32.729181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:32.825194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:33.161320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43375-eca2-4197-85b8-6d532f41ae1b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.161511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43375-eca2-4197-85b8-6d532f41ae1b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.161772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43375-eca2-4197-85b8-6d532f41ae1b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:33.163146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 73/144] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:33.166442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:33.173191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.173470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.173745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:33.200535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:33.201728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:33.228148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:33.364523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 74/145] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:33.376376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccab363-cc67-4e91-8cd4-379bd58d95cc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:33.424672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:33.425239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.425521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.425792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:33.441820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:33.446859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:33.447677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:33.448824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 72/146] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:33.457118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:33.577922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7486bf-d52b-45ab-9088-f36d67efede8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:33.586975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:33.619103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:33.619728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.620012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.620277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:33.620949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:33.621251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:33.622655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:33.636231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 75/147] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:33.642244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:33.733650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:33.757838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74849-cf28-4ea6-a516-1e344067e365 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:33.801354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:33.802045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.802359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.802633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:33.803783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:33.805356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:33.806980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 73/148] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:33 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:33.812682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:33.897541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:33.930246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c94f7-e57b-42ba-a1c3-5b9815f4c17a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:33.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:33.991627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:33.991910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:33.992187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.050431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:34.062938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd0f8-6750-428a-8841-c91696e33082 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.108741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.110241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.119936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.120580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.120859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.121129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.142555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:34.149330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:34.150193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:34.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:34.153748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 74/149] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:34.185566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:34.211256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:34.275278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 76/150] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:34.304421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:34.343324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fdc73-1bef-40f0-abe4-f0086d5e8ea2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.389149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.389769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.390090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.390393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.391058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:34.391530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.393056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.404533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 75/151] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:34.411453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:34.427947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:34.477057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bec7-56d3-4ab5-9529-228265c02197 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.513140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:34.539009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.539907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.540346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.540766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.542105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.543720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.547134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 77/152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:34 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:34.552834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:34.556850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2c10d-4bfa-4a28-bf9f-108c62c9d026 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.617563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.618658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.619167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.619636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] PATH_INFO: `/v3/users/b0f4c1ccc004436d9a059bea376d2c92` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.621243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f4c1ccc004436d9a059bea376d2c92)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.622917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.625112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 76/153] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:34 2022] GET /identity/v3/users/b0f4c1ccc004436d9a059bea376d2c92 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:34.642693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:34.688133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b703654-a2b3-4fe9-b894-f5dd5d9cd2c2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.737319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.738176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.738644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.739076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.739958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:34.740413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.742003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.751863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:34.758116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 78/154] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:34 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:34.904397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65643a4-3751-4764-a628-bb2e118e68b2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:34.994251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:34.994251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:34.994251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:34.994251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:34.994641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:34.995357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237d03-1f89-4e5a-9da2-b2f655fd19be None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:34.997314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 77/155] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:34 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:35.012638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:35.148372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44a04-7c5f-4137-a382-d0a374081e89 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.148664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44a04-7c5f-4137-a382-d0a374081e89 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.148876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b44a04-7c5f-4137-a382-d0a374081e89 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.151016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 78/156] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:35.164560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0138-fa61-4881-b378-9db0c62b372f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.164878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0138-fa61-4881-b378-9db0c62b372f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.165165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea0138-fa61-4881-b378-9db0c62b372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.211379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2eea0138-fa61-4881-b378-9db0c62b372f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:35.212632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2eea0138-fa61-4881-b378-9db0c62b372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:35.223297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:35.277540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5b4f6-3c7b-417e-b2f4-cad6a28d8e7e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:35.329618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:35.330538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.331491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.331900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/users/b0f4c1ccc004436d9a059bea376d2c92/roles/caeac9cc26f74ce18e08c111af67b330` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.334076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, user_id=b0f4c1ccc004436d9a059bea376d2c92, role_id=caeac9cc26f74ce18e08c111af67b330)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:35.335705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df191-7d9f-4c1c-9c16-18ce367a1baf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:35.384883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 79/157] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:35 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/users/b0f4c1ccc004436d9a059bea376d2c92/roles/caeac9cc26f74ce18e08c111af67b330 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:35.386469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee1e64-d2fe-409d-b70f-c056f958724c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.391392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee1e64-d2fe-409d-b70f-c056f958724c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.392189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee1e64-d2fe-409d-b70f-c056f958724c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.394564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 80/158] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:35.400776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb19c-8d37-4707-938d-58a21b10c7fc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.401271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb19c-8d37-4707-938d-58a21b10c7fc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.401684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bb19c-8d37-4707-938d-58a21b10c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.402819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 79/159] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:35.436584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ca2bb19c-8d37-4707-938d-58a21b10c7fc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:35.438031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ca2bb19c-8d37-4707-938d-58a21b10c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:35.522417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:35.537993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 81/160] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:35.959789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5eb-74cd-4222-aa8f-68fd671880da None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.960823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5eb-74cd-4222-aa8f-68fd671880da None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.961315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5eb-74cd-4222-aa8f-68fd671880da None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.962920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 80/161] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:35.968303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:35.968591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:35.968873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:35.983863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04d5eb-74cd-4222-aa8f-68fd671880da None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.000191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:36.001411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:36.109059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04d5eb-74cd-4222-aa8f-68fd671880da None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.141908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 82/162] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:36.142884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.175377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.176129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.176409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.176683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.189754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:36.197638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:36.202915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:36.203795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:36.204635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:36.207057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 81/163] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:36.213163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.267876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ac40b-98aa-4ed6-9d00-77d07afd9b9a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.290756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:36.306583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.307990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.308571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.309128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.322720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:36.328608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:36.329559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:36.330355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:36.334312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 83/164] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:36.340168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.378876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb759-719b-4cc0-89e4-fd74c3b5df97 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.444909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.445689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.446071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.446522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.447238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:36.447640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:36.449389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:36.459697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a53cc-2b90-4608-8580-9d45bac05e10 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.463449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 82/165] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:36.469092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.497372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.498593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.499490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.499941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.500962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:36.501556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:36.503335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:36.512538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 84/166] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:36.520008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.585340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:36.590644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:36.658586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dd3c8-8ad5-4b70-a0fe-00b959088fea None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.707751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83454-a507-4a80-a07a-2d088986e9f7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.709582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.711461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.711914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.712343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.716914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:36.718555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:36.720817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 85/167] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:36.726960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.785978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:36.787298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:36.787752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:36.788331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] PATH_INFO: `/v3/users/6ec940c1a9a046a9adaf049147f74a4b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:36.794904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec940c1a9a046a9adaf049147f74a4b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:36.797264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:36.799735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 83/168] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/users/6ec940c1a9a046a9adaf049147f74a4b => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:36.800979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:36.943877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d848ad4-7d5d-482c-89f0-fd91e0be806b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:36.955397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:36.985986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c815e-cafe-4bf4-b672-5ee718233a33 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:37.006066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.007850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.007850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.007850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.048877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:37.065732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.066839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.067393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.067866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.093928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:37.100013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:37.100900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:37.101663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:37.104338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 84/169] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:37.105416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:37.160714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:37.162318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:37.286920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bb105-76cd-4f4a-b53d-597679701245 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:37.345041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.346139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.346669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.347152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.377385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 86/170] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 13:10:37.379319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:37.400359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:37.423212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:37.437397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:37.439333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:37.555288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5788606-f8c1-47c2-b0f4-478f0cb6505d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:37.594080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.594744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.595023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.595298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.596236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:37.597127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:37.598549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45616025-e22b-4674-904d-08b28d6745bb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:37.603973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 85/171] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:37.604737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:37.607932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 87/172] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:37.609217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5cf3-1958-4139-850a-1e92438d9030 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.609509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5cf3-1958-4139-850a-1e92438d9030 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.609920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5cf3-1958-4139-850a-1e92438d9030 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.611150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 88/173] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:37.611866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5cf3-1958-4139-850a-1e92438d9030 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:37.702282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:37.730523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5cf3-1958-4139-850a-1e92438d9030 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:37.769465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.770197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.770638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.770979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.772737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:37.775314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e8c04-4abb-42ca-b4be-0f29a839c9f9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:37.777652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 89/174] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:37.778737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129857e6-2788-4f50-9893-b6c7cf7b18c1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.779086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129857e6-2788-4f50-9893-b6c7cf7b18c1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.779424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129857e6-2788-4f50-9893-b6c7cf7b18c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.791262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:37.803963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-129857e6-2788-4f50-9893-b6c7cf7b18c1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:37.805232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-129857e6-2788-4f50-9893-b6c7cf7b18c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:37.805693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de32f2-1142-4e8e-a3f5-512120b18ca9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:37.845736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:37.847120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.847407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.847705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.848987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:37.850643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:37.856212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 86/175] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:37.857164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:37.887446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:37.888849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c8a9-2122-42ee-8699-634e116967d9 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:37.889137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c8a9-2122-42ee-8699-634e116967d9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:37.889470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c8a9-2122-42ee-8699-634e116967d9 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:37.891614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 91/177] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:37.892227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c8a9-2122-42ee-8699-634e116967d9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.010580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.030543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b167752-3bbc-4def-a0fb-7a196918f805 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.076088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.076725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.077012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.077290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] PATH_INFO: `/v3/users/bc3984f67b124d15a4a2d085a72ab521` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.082243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] RBAC: Authorizing `identity:get_user(user_id=bc3984f67b124d15a4a2d085a72ab521)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:38.082243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:38.082625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 87/178] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/users/bc3984f67b124d15a4a2d085a72ab521 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:38.083373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.093131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c8a9-2122-42ee-8699-634e116967d9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.128124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.170927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.173103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.173756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.175601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.176775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=6ec940c1a9a046a9adaf049147f74a4b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:38.178093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:38.180557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60b9cc-5604-49eb-a15d-d1d328f35dc0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:38.193079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 92/179] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:37 2022] GET /identity/v3/role_assignments?user.id=6ec940c1a9a046a9adaf049147f74a4b&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:38.195558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab2be-8299-496b-b8fe-2329146e3582 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.196198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab2be-8299-496b-b8fe-2329146e3582 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.198364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab2be-8299-496b-b8fe-2329146e3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.231385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0e6ab2be-8299-496b-b8fe-2329146e3582 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:38.232960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0e6ab2be-8299-496b-b8fe-2329146e3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:38.254282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7f2b-d9a6-475d-8dec-df886cf5cddb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.294856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.295401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.295912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.296396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.297338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:38.298102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:38.299892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:38.308989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 88/180] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:38.310615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.328772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 93/181] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:38.330391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072c86-5ebb-436c-a301-42bb730c1b8f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.331415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072c86-5ebb-436c-a301-42bb730c1b8f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.331877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072c86-5ebb-436c-a301-42bb730c1b8f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.333411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 94/182] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:38.334337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072c86-5ebb-436c-a301-42bb730c1b8f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.443477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.448530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.465145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133f02e-d28a-4bea-b69c-09e3a8275eef None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.513238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.514245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.514905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.515347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.520533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072c86-5ebb-436c-a301-42bb730c1b8f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.577908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.578611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.578992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.579219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.596061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5045ebbd-26f4-46e8-88f5-5e280fdbdeda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:38.604574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:38.605475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:38.606284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 95/183] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:38.607388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.607881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.608293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.620554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:38.622436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:38.636069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:38.637692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:38.727216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 96/184] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:38.728571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.746908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.777163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 89/185] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:38.783991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.847671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:38.907692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dae36e-6b26-4c36-9b04-fbe7a067f834 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.951991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.952936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.953356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.953637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:38.954378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:38.954691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:38.955220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a06a-2c2d-4c1c-98a8-f53b1f12122b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:38.956232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:38.964674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 97/186] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:38.965637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:38.996510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:38.997673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:38.998328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:38.999064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] PATH_INFO: `/v3/projects/e1ad9f4485474d749ee4365f3d70c84f` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.000717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] RBAC: Authorizing `identity:get_project(project_id=e1ad9f4485474d749ee4365f3d70c84f)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.003876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd631352-1fa2-4aff-8616-4218fa3c0aad None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.005710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 90/187] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/projects/e1ad9f4485474d749ee4365f3d70c84f => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.007025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8a4f-9c35-4871-b972-8255baa87484 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.007491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8a4f-9c35-4871-b972-8255baa87484 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.008339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8a4f-9c35-4871-b972-8255baa87484 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.010066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 91/188] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:39.011248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8a4f-9c35-4871-b972-8255baa87484 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.073195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2b40-93e4-4935-981c-e4dcfb089697 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.076702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.089305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.107553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.108376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.108485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.108714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.119692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:39.123708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8a4f-9c35-4871-b972-8255baa87484 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a9275609-6852-4cf6-bbf9-c102c19bf536 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:39.124893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:39.125741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:39.126887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 98/189] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:39.127528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.127528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.127701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.145007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:39.146662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:39.159385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.160005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.160287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.160554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.173824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.176007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.177630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 92/190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.178418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.217482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 99/191] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:39.218360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.289549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069fc1a-4b31-44ee-9aac-be7e663fd584 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.304134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.324216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.324823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.325102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.325199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebb1d6-0784-4abe-883a-a490a6643472 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.325368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.326093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=e1ad9f4485474d749ee4365f3d70c84f, user.id=bc3984f67b124d15a4a2d085a72ab521) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:39.326430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.327871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.332987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.333558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 93/192] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/role_assignments?user.id=bc3984f67b124d15a4a2d085a72ab521&scope.project.id=e1ad9f4485474d749ee4365f3d70c84f&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.334389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.377264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.378460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.378759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.379267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.381254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.382817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.385938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 100/193] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.394249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.479954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3e6c3-4263-4d36-bf4a-a685ddaca482 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.521885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.522836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.523308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.523607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcd3a-9be4-4117-90ad-f16cbf6e25de None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.523759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.525053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:39.525053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.526523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.536067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 94/194] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.536638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.567356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.567972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.568251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.568524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.583109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.617289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.643198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.643624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d981f3c-3bb2-4b72-9f18-08eb30d15b06 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.644749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.677103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.677714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.677995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.678297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.678951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.680403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.701093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 95/195] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:39 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:39.707330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.748791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 101/196] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:39.754967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.823355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.835169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cca9d5-f48f-4d33-9860-9102f31bf1d5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.842314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:39.870103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f217449-82d5-4d19-894e-cffd1af3744d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:39.876951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.878492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.892341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:39.898582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:39.899638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:39.900380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 96/197] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:39.901041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:39.914577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:39.915223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:39.915501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:39.915775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:39.916926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:39.918410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:39.919989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 102/198] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:39.923360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.014629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bdd22-5dc9-47e0-86fd-e29b795ccbed None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.053547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011bb6-22eb-4b0e-b937-765106ac0ee9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.054853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.055898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.057135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.057610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.059008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.060646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.062974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 97/199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:40.064245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.091617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.092429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.092865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.093241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.094019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:40.094461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.095647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.096072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.106257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 103/200] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:40.107256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.113778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.182528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2665-eacb-46ca-b06e-90caf41ed734 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.219236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.219853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.220188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.220467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.233552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e62e-5823-494c-8a75-31220a070d13 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.274548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.275473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.275760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.276039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.276779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=97ae2c892ced479da3bf44ad300c8326) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:40.277092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.279004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.286742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 104/201] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/role_assignments?user.id=97ae2c892ced479da3bf44ad300c8326&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:40.287395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.295269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.296807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.326636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.365536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.412039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c382-3bc8-4f35-a9f0-999ba1b53d9a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.465269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.465845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.466129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.466435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] PATH_INFO: `/v3/users/b0f4c1ccc004436d9a059bea376d2c92` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.467720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f4c1ccc004436d9a059bea376d2c92)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.469208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.471115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 105/202] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/users/b0f4c1ccc004436d9a059bea376d2c92 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:40.475792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 98/203] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:40.477162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.483322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.614933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f748a9-b222-4193-a876-e284a0bcc9c4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.620466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd8d3b-4623-4af2-9cfd-06bc74ef9257 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.667178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.683541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.684163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.684447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.684722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.691445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:40.692101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:40.692384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:40.692659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:40.694898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.696349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.698168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:40.702569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:40.711225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.792719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:40.794225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:40.902450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 106/205] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 13:10:40.908153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:40.931595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ae8ee-7e54-4849-b81f-41d094deb6f3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:40.948548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:41.004902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:41.005514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:41.005792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:41.006062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:41.010860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=97ae2c892ced479da3bf44ad300c8326) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:41.011181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:41.012629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:41.021565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067ca1-9687-4473-afef-d6a42a3610a7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:41.023912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 100/206] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/role_assignments?user.id=97ae2c892ced479da3bf44ad300c8326&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:41.062327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:41.062898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:41.063179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:41.063452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:41.064609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:41.066898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970099f-ac44-4de6-a10d-323215605778 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:41.068733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:40 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:41.074590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:41.140327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:41.208616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf58f71-f172-412a-b4a6-10daa87a3e91 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:41.257121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:41.257744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:41.258027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:41.258328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:41.259153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, scope.project.id=4daea584bc4443619716d7ba810e67be, user.id=b0f4c1ccc004436d9a059bea376d2c92) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:41.259463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:41.260920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ab315-1c48-4964-bb95-8c483990bd80 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:41.267411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:41 2022] GET /identity/v3/role_assignments?user.id=b0f4c1ccc004436d9a059bea376d2c92&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:42.173265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854f98-5f0d-4e4a-b251-2de199dae45e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.173770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854f98-5f0d-4e4a-b251-2de199dae45e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.173770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854f98-5f0d-4e4a-b251-2de199dae45e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.175924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 108/209] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:42.181089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab5c8-13ca-43da-8a93-347b3fd7d8d3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.181500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab5c8-13ca-43da-8a93-347b3fd7d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.181645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab5c8-13ca-43da-8a93-347b3fd7d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.200957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-297ab5c8-13ca-43da-8a93-347b3fd7d8d3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:42.202153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-297ab5c8-13ca-43da-8a93-347b3fd7d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:42.279067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:42.443216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4653-00cb-4efc-99a1-af65348eb17d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.443589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4653-00cb-4efc-99a1-af65348eb17d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.443970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c4653-00cb-4efc-99a1-af65348eb17d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.445588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 109/211] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:42.451077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.451481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.451863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.470849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:42.472792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:42.522947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:42.545529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 103/212] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:42.551519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4653-00cb-4efc-99a1-af65348eb17d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:42.665389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c4653-00cb-4efc-99a1-af65348eb17d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:42.667958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:42.702172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:42.702767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.703047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.703321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.716976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:42.723163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:42.725728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:42.727699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 110/213] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:42.734667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:42.833049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:42.844354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954afc-9a38-4b36-a0cf-3ec0aadab6cf None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:42.882948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:42.883561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.883843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.884116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.884786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:42.885088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:42.886500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4a13b-1119-454e-b2ab-00b95ef80840 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:42.894803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 104/214] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:42.900317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80207c4-5390-4e7b-a64d-5e9be93f847f None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.900596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80207c4-5390-4e7b-a64d-5e9be93f847f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.900867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80207c4-5390-4e7b-a64d-5e9be93f847f None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.902126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 105/215] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:42.906833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80207c4-5390-4e7b-a64d-5e9be93f847f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:42.950606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235e53-a380-4fef-b14f-1cd6d8760068 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:42.953937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:42.992568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:42.993940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:42.994523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:42.994938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:42.996939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:42.998851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eccf0d-1ea9-4409-a64c-e347985122db None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.000738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 111/216] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:43.002203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.002766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.003037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.019034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80207c4-5390-4e7b-a64d-5e9be93f847f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.023672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:43.024880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:43.057232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.057753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.057857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.058136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.058507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] PATH_INFO: `/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.075210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] RBAC: Authorizing `identity:get_user(user_id=b63f780c1ccb4d2fa4f77c755a2719cd)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.076676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.079222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 106/217] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:42 2022] GET /identity/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:43.079888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.107614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 112/218] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:43.108461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.203579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.208547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7ac7-029c-4c3a-809b-1663e405f6bf None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.240138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985e83-ad52-4861-bbfc-bfa67c0872dc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.253941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.254645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.255080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.255398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.256156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.257892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.288138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 107/219] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:43 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:43.289594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.290835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.291346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.291809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.350244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.380369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.382267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247f0cc-f66c-41fd-875d-e74837c7796f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.405657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.516264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 113/220] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:43.517620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6c78-484d-4619-b206-34f0f62c3a1e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.517908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6c78-484d-4619-b206-34f0f62c3a1e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.518878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f6c78-484d-4619-b206-34f0f62c3a1e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.521687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 114/221] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:43.524717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6c78-484d-4619-b206-34f0f62c3a1e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.529814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50506-9920-4944-964e-fd8d8fabca26 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.570300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.570942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.571221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.571489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.585820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-181eefcd-64c1-49d9-9d98-e08119db5c72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:43.591189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:43.592053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:43.592819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 108/222] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:43.593993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.593993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.594183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.610246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.615321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:43.617569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:43.632721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.666346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f6c78-484d-4619-b206-34f0f62c3a1e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.703907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 109/223] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:43.705078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.715990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.716692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.716973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.717243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.718813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.720671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.724736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 115/224] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:43.735226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.883144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c595c-1a25-44e7-be5c-16e87dd50eae None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.927242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fbecb-1e4f-409e-b736-11d9ee608e2d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:43.958498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.959386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.959801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.960207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.961019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:43.961457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.963005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:43.978968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 110/225] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:43.984515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:43.984952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:43.994040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:43.994694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:43.994973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:43.995247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:43.996011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=b63f780c1ccb4d2fa4f77c755a2719cd) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:43.996294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:43.997731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.009410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 116/226] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/role_assignments?user.id=b63f780c1ccb4d2fa4f77c755a2719cd&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:44.009710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:44.009804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.150087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a4aee-2897-446a-8110-e6ba4fdcbe0f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.194203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.194872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.195716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.196001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.208082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:44.213934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:44.214855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:44.215646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:44.220448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 117/227] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:44.222243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.257450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a699-d56e-488d-8fd5-81c767811230 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.311921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:44.327192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.327836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.328115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.328385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.329657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:44.331421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.333030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:43 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:44.339184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.406169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f688-7526-4376-ac33-6c19763ce2fe None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.478889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:44.479825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.480445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.480721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.480982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.481658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:44.481961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:44.483566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.504972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f3ac-e8ff-4a8d-b288-bf28378f63cb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.508603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 118/229] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:44.513825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.575471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.576132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.576414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.576688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.579528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:44.583288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.589442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 112/230] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:44 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:44.591823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.710896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa31003-ee06-458c-a7b2-bedc1604ad03 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.749483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.750836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.751270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.751550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/users/97ae2c892ced479da3bf44ad300c8326/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.753626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, user_id=97ae2c892ced479da3bf44ad300c8326, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:44.755438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.775898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:44 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/users/97ae2c892ced479da3bf44ad300c8326/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:44.788098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735a5bb-7117-4a12-9b80-e6a5f2374bff None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:44.818671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:44.846004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:44.846735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:44.847211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:44.847510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:44.848719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:44.850317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:44.852236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 119/232] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:44 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:44.858038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:44.862637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:44.970990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479645b-a33b-4cab-ad5e-0d67ce2fdf43 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:45.010093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:45.010776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:45.011057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:45.011333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:45.012605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:45.014068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e9a42-cf42-4e6f-ba1f-c4c00dfb0afe None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:45.019607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 114/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:44 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:45.022122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:45.132479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7d94b-4449-42f2-afba-1463ad968f0a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:45.172456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:45.173409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:45.173695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:45.173970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/users/97ae2c892ced479da3bf44ad300c8326/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:45.178625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, user_id=97ae2c892ced479da3bf44ad300c8326, role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:45.180083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ab209-37c5-4c9e-8f52-5805de10cd9c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:45.196158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 120/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:45 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/users/97ae2c892ced479da3bf44ad300c8326/roles/ee3812bbf20246aeb58841361e74fe32 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:45.996057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d0dd-7c2d-4d7c-a454-308e1587a6ff None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:45.996566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d0dd-7c2d-4d7c-a454-308e1587a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:45.996637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2d0dd-7c2d-4d7c-a454-308e1587a6ff None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:45.998265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 115/235] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:46.003814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d7e7-75ab-4faa-9c99-ece64fc00714 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.004286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d7e7-75ab-4faa-9c99-ece64fc00714 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.004370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53d7e7-75ab-4faa-9c99-ece64fc00714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.027212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8e53d7e7-75ab-4faa-9c99-ece64fc00714 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:46.028426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8e53d7e7-75ab-4faa-9c99-ece64fc00714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:46.079896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:46.116544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:46.131613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5500b5d-ddfe-4da3-9718-7618096bb98c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.131890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5500b5d-ddfe-4da3-9718-7618096bb98c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.132160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5500b5d-ddfe-4da3-9718-7618096bb98c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.133583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 116/237] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:46.146376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c912-600a-471e-b54a-29ad08738c9a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.146680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c912-600a-471e-b54a-29ad08738c9a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.146930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c912-600a-471e-b54a-29ad08738c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.168917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c9f3c912-600a-471e-b54a-29ad08738c9a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:46.170100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c9f3c912-600a-471e-b54a-29ad08738c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:46.254590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:46.431451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa132a3-fd30-46aa-a6b1-5ac33f796055 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.432085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa132a3-fd30-46aa-a6b1-5ac33f796055 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.432561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa132a3-fd30-46aa-a6b1-5ac33f796055 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.434338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 117/239] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:46.439561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.440161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.440697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.445193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa132a3-fd30-46aa-a6b1-5ac33f796055 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:46.460828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:46.462097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:46.554580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:46.570103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:46.593433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa132a3-fd30-46aa-a6b1-5ac33f796055 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:46.628924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:46.629605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.629888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.630162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.640721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:46.647690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:46.648543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:46.649343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:46.653860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 118/241] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:46.655470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:46.656216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:46.700964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:46.814678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fcc06-e6c5-4040-89ce-c8621d6a1b76 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:46.863555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c63e-baa7-4140-9c56-78fc2589539c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:46.864786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:46.865408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.865683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.865953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.866654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:46.866957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:46.868804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:46.885620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 124/242] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:46.896844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:46.920553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:46.927299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:46.927947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:46.928230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:46.928511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:46.929684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:46.931166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:46.932736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 119/243] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:46.933577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.018668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.026644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59273-4483-4bb0-82f4-ebefbb6254ec None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.040855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063854c6-91fd-4857-bc1e-dd12ce0ed0ab None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.068791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.069813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.070189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.070999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] PATH_INFO: `/v3/users/f7a7d5a786c44d2191f69801c975abec` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.081149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.081885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.082280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.082650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.085870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] RBAC: Authorizing `identity:get_user(user_id=f7a7d5a786c44d2191f69801c975abec)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.087515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.089281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 125/244] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:46 2022] GET /identity/v3/users/f7a7d5a786c44d2191f69801c975abec => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:47.090243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.101135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:47.106925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:47.107965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:47.108875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:47.111498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 120/245] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:47.113085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.182697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.201374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bf080-0a5c-4a50-bd0b-53cb551e0399 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.228323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e2d28-fb13-47b7-988e-fdef56ed6a5a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.237819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.238861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.239338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.239826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.240796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.242504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.265249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.265861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.266140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.266470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.267148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 126/246] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:47 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:47.268479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.283556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.348851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.351121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.391681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6b202-895c-4d10-8f52-7d3fee04bcfc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.416857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.434049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.435146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.435620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.436165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.437046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:47.437553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.439369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.449644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 127/247] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:47.458263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.492310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 121/248] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:47.500501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.564735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.603006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a386-a18b-4dbb-b288-a62215348b5a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.648040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.649016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.649576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.649855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] PATH_INFO: `/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.651156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] RBAC: Authorizing `identity:get_user(user_id=b63f780c1ccb4d2fa4f77c755a2719cd)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.653167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.654063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f676283-ac77-4c35-8c97-1761db249098 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.654811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 128/249] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:47.660801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.702313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.703080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.703365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.703638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.704837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.706637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.708634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 122/250] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:47.722530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.759684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.790505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795d3fb-5162-4c82-b93e-aa8c0b97a781 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.846013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.848091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.848091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.848091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.850609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.852081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a9b0-f1b0-4138-9001-a7a4faef9ce5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.854072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 129/251] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:47.855360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a139-4f04-4c8f-80ea-9db362d51c59 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.855644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a139-4f04-4c8f-80ea-9db362d51c59 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.855914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2a139-4f04-4c8f-80ea-9db362d51c59 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.857286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 130/252] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:47.862067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2a139-4f04-4c8f-80ea-9db362d51c59 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:47.865635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306efbd-1ce1-4ef3-8ebc-9ddee4ea3ad5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:47.880074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:47.908929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:47.910054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.910365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.910637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.911667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=f7a7d5a786c44d2191f69801c975abec) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:47.912920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:47.914419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4db43-9e70-467b-9057-67a7a3d310c3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:47.921200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 123/253] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:47 2022] GET /identity/v3/role_assignments?user.id=f7a7d5a786c44d2191f69801c975abec&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:47.923161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d22e-2d7a-4675-a91d-87c71c1a9425 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:47.923464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d22e-2d7a-4675-a91d-87c71c1a9425 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:47.923742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d22e-2d7a-4675-a91d-87c71c1a9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:47.951136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-51c2d22e-2d7a-4675-a91d-87c71c1a9425 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:47.952422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-51c2d22e-2d7a-4675-a91d-87c71c1a9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:48.003144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2a139-4f04-4c8f-80ea-9db362d51c59 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:48.049843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:48.050594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.050845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.051109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/users/b63f780c1ccb4d2fa4f77c755a2719cd/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:48.051542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 124/254] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:48.059889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, user_id=b63f780c1ccb4d2fa4f77c755a2719cd, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:48.062139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a6165-f332-4b51-b266-28c6891586a2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:48.077758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 131/255] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:47 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/users/b63f780c1ccb4d2fa4f77c755a2719cd/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:48.089187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef09b-5dd5-49ee-9e1a-95cf80e1d18c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.089365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef09b-5dd5-49ee-9e1a-95cf80e1d18c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.089642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ef09b-5dd5-49ee-9e1a-95cf80e1d18c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:48.091457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 125/256] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:48.098953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.099212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.099483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:48.123686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:48.125005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:48.201057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:48.207874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 132/257] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:48.361715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ef09b-5dd5-49ee-9e1a-95cf80e1d18c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:48.388197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:48.475677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ef09b-5dd5-49ee-9e1a-95cf80e1d18c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:48.515824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:48.516469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.516749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.517022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:48.529340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:48.534608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:48.535640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:10:48.536404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:48.541024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 126/258] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:48.546508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:48.641847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:48.693126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11514726-89ec-41c6-93ee-8f243fb625bb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:48.775992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:48.776986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.777457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.777937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:48.778849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:48.779348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:48.780930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:48.797630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 133/259] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:48.804566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:48.838565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:48.897100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b264d3-cc59-451e-b784-d760f4176734 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:48.955309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:48.990274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:48.990928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:48.991203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:48.991468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.022246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:49.027022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:49.027933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:10:49.028701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:49.029282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 127/260] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:10:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:49.040258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:49.078160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25218c-0028-49ca-9499-bbcbd1638548 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.152908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.153911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.154417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.154905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.157008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.158722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.161114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 134/261] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:48 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:49.167658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:49.253253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cd41b-990d-48e8-9c8b-c144b939a671 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.317067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.317678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.317953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.318238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.318908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:49.319205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.320592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.337179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 128/262] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:49.343232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:49.347343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:49.432434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cd7a8-6959-47b4-ab3e-bf2af0c05765 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.465064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcd914-7279-4bba-acbc-77488b25e77f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.502669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.503456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.503760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:49.504406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.504667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] PATH_INFO: `/v3/users/97ae2c892ced479da3bf44ad300c8326` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.505904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] RBAC: Authorizing `identity:get_user(user_id=97ae2c892ced479da3bf44ad300c8326)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.507706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.509275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 129/263] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/users/97ae2c892ced479da3bf44ad300c8326 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:49.515521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:49.535638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.536272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.536552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.536823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.607791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:49.641555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2614bf-8f95-407d-856c-fa73739a8749 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.681938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.682633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.682850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.683119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.692442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.693910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.808169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 135/264] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:49.813778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:49.844029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:49.907016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.908514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.919888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ed8a-7532-432a-a938-9d0635218b8e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:49.957588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:49.958176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:49.958482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:49.958751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:49.959891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:49.961528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:49.963273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 136/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:49.970090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:50.052096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:50.081828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f4d8-f480-40ff-a867-5344b0af5696 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:50.110643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:50.119920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:50.120543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:50.120822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:50.121093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:50.121818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=97ae2c892ced479da3bf44ad300c8326) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:50.122128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:50.123730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:50.130510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 137/266] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/role_assignments?user.id=97ae2c892ced479da3bf44ad300c8326&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:50.137083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 130/267] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:50.141880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:50.290410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e37d-905c-48cf-9fc7-83a998934879 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:50.335270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:50.335925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:50.336207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:50.336480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:50.343072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:50.344572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057cd27-b44b-4eff-9e6a-f12e492dfa16 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:50.346403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 138/268] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:50 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:50.353437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:50.482560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213928a8-e234-4282-85c6-312bbec00a56 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:50.527518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:50.528142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:50.528423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:50.528695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:50.529425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=97ae2c892ced479da3bf44ad300c8326) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:50.529732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:50.531213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0f33f-058e-401e-be5d-60678cc66dbc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:50.538085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 131/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:50 2022] GET /identity/v3/role_assignments?user.id=97ae2c892ced479da3bf44ad300c8326&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:50.839039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052451a1-a6bb-45a6-95ef-1575d0e9701c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:50.839354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052451a1-a6bb-45a6-95ef-1575d0e9701c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:50.839594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052451a1-a6bb-45a6-95ef-1575d0e9701c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:50.841241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 139/270] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:50.846998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad8f2f-88cc-419b-8b75-93b3c88dc0c2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:50.847277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad8f2f-88cc-419b-8b75-93b3c88dc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:50.847554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad8f2f-88cc-419b-8b75-93b3c88dc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:50.879069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-32ad8f2f-88cc-419b-8b75-93b3c88dc0c2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:50.880277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-32ad8f2f-88cc-419b-8b75-93b3c88dc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:50.923095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:50.974691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 132/271] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:51.085519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd3afc-5461-4028-b311-826371982d32 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.086005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd3afc-5461-4028-b311-826371982d32 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.086005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd3afc-5461-4028-b311-826371982d32 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.087367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 140/272] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:51.092933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c1b2-27d2-4786-bde9-1cb6cbe8fc07 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.093224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c1b2-27d2-4786-bde9-1cb6cbe8fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.093498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321c1b2-27d2-4786-bde9-1cb6cbe8fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.115249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e321c1b2-27d2-4786-bde9-1cb6cbe8fc07 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:51.116481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e321c1b2-27d2-4786-bde9-1cb6cbe8fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:51.195432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 133/273] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:51.256209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738821c-7b66-44c9-97af-d8db5e59538d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.256523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738821c-7b66-44c9-97af-d8db5e59538d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.256760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738821c-7b66-44c9-97af-d8db5e59538d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.258423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 141/274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:51.263693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aee2f-77dc-482e-b3ac-9fded899e0c7 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.264049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aee2f-77dc-482e-b3ac-9fded899e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.264331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595aee2f-77dc-482e-b3ac-9fded899e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.278426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738821c-7b66-44c9-97af-d8db5e59538d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.290637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-595aee2f-77dc-482e-b3ac-9fded899e0c7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:51.292163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-595aee2f-77dc-482e-b3ac-9fded899e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:51.323389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.395423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 134/275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:51.406237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb2d1-379c-4c86-b2bd-ac093e755b0a None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.406237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb2d1-379c-4c86-b2bd-ac093e755b0a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.406237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb2d1-379c-4c86-b2bd-ac093e755b0a None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.406237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 135/276] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:51.409000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.409418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.409918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.415988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738821c-7b66-44c9-97af-d8db5e59538d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.429528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:51.431060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:51.452431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.452787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.453078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.453337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.453613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.465004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:51.470584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:51.471574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:51.473082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 142/277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:10:51.477480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.511382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 136/278] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:51.518808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.573126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.587428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20624c51-9546-4c68-ba63-9da2b7215ddd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.623616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.624233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.624513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.624786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.625550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:51.625858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:51.627373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:51.633148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba4a5-d8d5-4d84-9534-c6228448f5d7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.638147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 143/279] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:51.644347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.671385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.671941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.672220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.672490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.682818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:51.687594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:51.688462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:51.689218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 137/280] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:51.694157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.713003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.752336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5afaa-cff0-41ce-8374-85f1561d033f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.787863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.788484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.788759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.789026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] PATH_INFO: `/v3/users/b0ea806163b64240af3c3ad4ad642ff5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.800361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c67b-4e6d-4113-8d9f-1c749dbb7d3f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.803503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] RBAC: Authorizing `identity:get_user(user_id=b0ea806163b64240af3c3ad4ad642ff5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:51.804955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:51.806782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 144/281] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/users/b0ea806163b64240af3c3ad4ad642ff5 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:51.807355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.818207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.839312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.840046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.840328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.840603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.851327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:51.856114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:51.857131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:51.857887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 138/282] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:51.858682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.906023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8429e2-6133-4e10-97f4-1a56df26d3dc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.933865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:51.941070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.941751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.942033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.942338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.943008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:51.943312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:51.944684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:51.952977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 145/283] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:51.953759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:51.956874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9ef03-ac29-457a-9891-d3fb6ce49fb7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:51.989821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:51.990479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:51.990762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:51.991034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:51.992138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:51.993613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:51.995206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 139/284] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:51.995966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.025286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.055533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f47b-1bd9-41af-8709-8e365aaf3d65 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.089037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.089636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.089900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.090175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.091157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, user.id=b0ea806163b64240af3c3ad4ad642ff5, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:52.091264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.092639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.096458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca87997-3391-49c4-8006-f1f2ae3a2eb5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.097605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 146/285] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/role_assignments?user.id=b0ea806163b64240af3c3ad4ad642ff5&scope.system=all&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:52.098410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.149109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.149736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.150162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.150472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.151160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:52.151464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.152896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.163625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 140/286] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:52.164579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.177336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.220545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724087-91d8-40e0-ae11-9cad7b8e8e12 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.261055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.261698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.261975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.262271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] PATH_INFO: `/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.263418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] RBAC: Authorizing `identity:get_user(user_id=b63f780c1ccb4d2fa4f77c755a2719cd)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.264880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.272528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 147/287] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/users/b63f780c1ccb4d2fa4f77c755a2719cd => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:52.272528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.274377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.299580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bce5-2bda-47a6-968b-9a5ce0e5ce6a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.336195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.337177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.337660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.338146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.339023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.340664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.363835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 141/288] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:10:52 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:10:52.364786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.398877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e07c09-0736-416f-924c-0d298e8febad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.443431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.444325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.444731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.445223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] PATH_INFO: `/v3/users/f7a7d5a786c44d2191f69801c975abec` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.446596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] RBAC: Authorizing `identity:get_user(user_id=f7a7d5a786c44d2191f69801c975abec)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.448273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.449375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.450742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 148/289] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/users/f7a7d5a786c44d2191f69801c975abec => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:52.459131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.509806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e200f0-db0b-46e6-bdff-e92e70bc2359 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.554054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.554921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.555376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.556604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.557167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.601267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1c22d-c2c6-4b64-945d-84bfcff06fef None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.648776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.649522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.649808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.650085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.651268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.652707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.654820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 149/290] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:52.657242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.659383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.662497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.730675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.781864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 142/291] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:52.788182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:52.812446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212366-0f54-4f02-8ad3-332d338ac8cc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.857434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.858733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.859022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.859577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/users/f7a7d5a786c44d2191f69801c975abec/roles/caeac9cc26f74ce18e08c111af67b330` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.861753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, user_id=f7a7d5a786c44d2191f69801c975abec, role_id=caeac9cc26f74ce18e08c111af67b330)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.864396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.883689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:52.899328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 150/292] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:10:52 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/users/f7a7d5a786c44d2191f69801c975abec/roles/caeac9cc26f74ce18e08c111af67b330 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:52.928100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba689-8f7b-45fa-8e6c-320ad9334016 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:52.969170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:52.969882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:52.970169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:52.970523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:52.971769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:52.973289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b265f-c4f2-4866-9711-d28646f9b68d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:52.975325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 143/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:52.982820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:53.145946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce99b6-dbfe-4c66-9549-eaaf32e182f2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:53.183863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:53.184528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:53.184814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:53.185090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:53.185838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=b63f780c1ccb4d2fa4f77c755a2719cd) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:53.186148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:53.187681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9068e-a606-437d-81cf-d58420d79429 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:53.195194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 151/294] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:52 2022] GET /identity/v3/role_assignments?user.id=b63f780c1ccb4d2fa4f77c755a2719cd&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:54.527826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a4a65-3575-4b5c-a42f-169b4368d42f None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:54.528339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a4a65-3575-4b5c-a42f-169b4368d42f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:54.528411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a4a65-3575-4b5c-a42f-169b4368d42f None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:54.529870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 144/295] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:54.535753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d661b0-0305-44c7-a034-7dd629093bc5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:54.536153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d661b0-0305-44c7-a034-7dd629093bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:54.536346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d661b0-0305-44c7-a034-7dd629093bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:54.555146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-78d661b0-0305-44c7-a034-7dd629093bc5 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:54.556359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-78d661b0-0305-44c7-a034-7dd629093bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:54.614438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:54.626381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 152/296] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:54.896070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a4a65-3575-4b5c-a42f-169b4368d42f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:54.932868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.016885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a4a65-3575-4b5c-a42f-169b4368d42f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.039646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e150d-2945-4a3c-8e62-5248209af618 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.040093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e150d-2945-4a3c-8e62-5248209af618 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.040469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e150d-2945-4a3c-8e62-5248209af618 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.045875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 153/297] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:55.047464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2ec5-524f-4a3e-b664-6f47ac75e8f6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.047845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2ec5-524f-4a3e-b664-6f47ac75e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.048476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf2ec5-524f-4a3e-b664-6f47ac75e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.057181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.058493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.058493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.058493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.068969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:55.070576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-dedf2ec5-524f-4a3e-b664-6f47ac75e8f6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:55.072009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dedf2ec5-524f-4a3e-b664-6f47ac75e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:55.073881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:55.074783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:55.075549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:55.080128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 145/298] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:55.081942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.157365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 154/299] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:55.185007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.196795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c70c7-a6e3-4f7c-9dd8-d8ae04138d10 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.201431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd096e-7916-4f93-9d97-da42cf54d95a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.201717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd096e-7916-4f93-9d97-da42cf54d95a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.201996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd096e-7916-4f93-9d97-da42cf54d95a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.203375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 155/300] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:10:55.208613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.208893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.209165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.229052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:55.230387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:55.234875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.235730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.236226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.236739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.238298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:55.238797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.240183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.248844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 146/301] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:55.254452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.313315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 156/302] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:55.370825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33ab9f-68e6-4b29-9ee2-b8ac2b600e67 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.405918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.406842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.407289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.407701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] PATH_INFO: `/v3/users/b0ea806163b64240af3c3ad4ad642ff5` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.409533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] RBAC: Authorizing `identity:get_user(user_id=b0ea806163b64240af3c3ad4ad642ff5)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.411252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3f788-8f45-4a17-81f4-3a646a0b6d66 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.413273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 147/303] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/users/b0ea806163b64240af3c3ad4ad642ff5 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:55.419069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.431645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d3c0-e4a2-4663-8776-b0c87338735c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.432131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d3c0-e4a2-4663-8776-b0c87338735c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.433723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d3c0-e4a2-4663-8776-b0c87338735c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.435225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 148/304] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:55.441334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.441773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.442185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.461117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:55.462348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:55.477301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.486186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.532042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 149/305] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:55.535263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.540566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fecd6-aa7a-4fc5-bf5e-a3d7b3446c09 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.576697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.577353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.577627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.577898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] PATH_INFO: `/v3/system/users/b0ea806163b64240af3c3ad4ad642ff5/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.579466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0ea806163b64240af3c3ad4ad642ff5, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.581370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.592477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 157/306] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Sep 9 13:10:55 2022] PUT /identity/v3/system/users/b0ea806163b64240af3c3ad4ad642ff5/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:10:55.593642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.677515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8460a4-32fc-4bf0-a054-87445cde49d3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.716383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.717038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.717318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.718065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.729060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e1ad0-a555-47fc-b238-a0a069347026 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.733802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:55.739895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:55.740859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:55.741633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 150/307] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:55.747423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.750886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.771314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:55.777996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.778884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.778992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.779220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.784231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.786815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.789207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 158/308] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:55.794973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.886382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a01b4-1fc6-4346-86a1-574d005a1edb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.908294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913c073-aa68-4df5-acf3-dc1ee4c16ff8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:55.921466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.922095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.922373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.922641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.923666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:55.923878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.925390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.938453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 151/309] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:55.938453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:55.953065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:55.954156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:55.955036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:55.955629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] PATH_INFO: `/v3/groups` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:55.957172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:55.959294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:55.978936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 159/310] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Sep 9 13:10:55 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:10:55.979775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.022044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.063614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d1a05-5d8b-48aa-9fe5-83fd9d952264 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.068632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.109461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.110117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.110441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.110711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.126946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:56.135373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:56.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:56.137127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 152/311] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:56.142503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.155890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd5c10-1cc0-4800-970e-9331e03ee26c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.203759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.203759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.203759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.203759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] PATH_INFO: `/v3/users/142ff2921c6f40c389966473e23139d5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.223032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] RBAC: Authorizing `identity:get_user(user_id=142ff2921c6f40c389966473e23139d5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:56.224520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:56.227072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 160/312] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:55 2022] GET /identity/v3/users/142ff2921c6f40c389966473e23139d5 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:56.232453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.292561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804153-6b30-436e-89a9-9c34db74c7ff None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.333182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.340958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.342291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.342770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.343234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.344122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:56.345159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:56.348069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:56.359559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8c031-ec11-42a2-821c-3d4dd57b2d48 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.360301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:56.366120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.366857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.408399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.409389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.409862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.410375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.411291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, user.id=142ff2921c6f40c389966473e23139d5, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:56.411817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:56.414406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:56.421124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 161/314] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Sep 9 13:10:56 2022] GET /identity/v3/role_assignments?user.id=142ff2921c6f40c389966473e23139d5&scope.system=all&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:56.493239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937e28-a099-4ca3-ba4c-570c590763c9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.536279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.537881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.538407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.538679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] PATH_INFO: `/v3/users/f7a7d5a786c44d2191f69801c975abec` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.539913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] RBAC: Authorizing `identity:get_user(user_id=f7a7d5a786c44d2191f69801c975abec)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:56.541477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:56.543324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:56 2022] GET /identity/v3/users/f7a7d5a786c44d2191f69801c975abec => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:56.549248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.661905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1f98b-bf0e-493c-9a8b-9c436f1d5e9f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:56.697813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:56.698446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:56.698762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:56.699081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:56.733313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.770983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:56.772358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:56.878284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:10:56.883654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:56.948813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:56.992961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fabc55-8039-4831-993b-809ad86a305f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:57.027154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:57.027705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:57.027980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:57.028249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:57.029363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:57.030824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615a8d3-daff-4ce3-917f-237c6ae6a85a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:57.032606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:10:56 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:57.039681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:57.108164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:57.144430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b0660-e610-4969-9c46-88cca05807b1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:57.179360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:57.179969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:57.180248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:57.180520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:57.181248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, scope.project.id=bd125161f0bb49bcb2817c240999f774, user.id=f7a7d5a786c44d2191f69801c975abec) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:57.181557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:57.183073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62684c-6680-4e1f-b1a2-8aa25c9a665a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:57.189490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:10:57 2022] GET /identity/v3/role_assignments?user.id=f7a7d5a786c44d2191f69801c975abec&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:57.815826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ac41c-2993-43c6-9946-8a5412766ef3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:57.816331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ac41c-2993-43c6-9946-8a5412766ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:57.816404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ac41c-2993-43c6-9946-8a5412766ef3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:57.818014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:57.823457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4b0a-a625-41f7-8aed-8d462d8a5d4a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:57.823859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4b0a-a625-41f7-8aed-8d462d8a5d4a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:57.824037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a4b0a-a625-41f7-8aed-8d462d8a5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:57.842316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ef2a4b0a-a625-41f7-8aed-8d462d8a5d4a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:57.843502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ef2a4b0a-a625-41f7-8aed-8d462d8a5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:57.911231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 164/320] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:58.178527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ac41c-2993-43c6-9946-8a5412766ef3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.259629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279b35-6da3-4635-ad88-1ac8d9538657 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.259951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279b35-6da3-4635-ad88-1ac8d9538657 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.260178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24279b35-6da3-4635-ad88-1ac8d9538657 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.261908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 165/321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:58.266574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.266862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.267143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.286058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:58.287277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:58.288924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ac41c-2993-43c6-9946-8a5412766ef3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.320896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:58.328585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.329636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.329918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.330193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.345822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:58.347445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:58.354764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:58.355631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:10:58.356398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 157/322] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:58.361505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.361952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 166/323] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:10:58.467861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3690-88c6-4a78-b134-296471f710e5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.501170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.501781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.502061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.502377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.503097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:58.503405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:58.504778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:58.513216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 158/324] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:58.519923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.626772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e264-f6a3-403c-a2ad-cee93fb63df6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.628587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.665182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.665825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.666103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.666409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] PATH_INFO: `/v3/users/b0ea806163b64240af3c3ad4ad642ff5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.667551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] RBAC: Authorizing `identity:get_user(user_id=b0ea806163b64240af3c3ad4ad642ff5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:58.668981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:58.676042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 167/325] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:58 2022] GET /identity/v3/users/b0ea806163b64240af3c3ad4ad642ff5 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:58.677046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.689745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:58.737801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:58.738051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951774-b590-45da-96e7-96f22423b0dd None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.771413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.772031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.772312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.772581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.773658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:58.775118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7af2bf-04cc-4e07-85e8-a3310edd00d9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:58.776652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 159/326] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:58.777738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57873b2-f8e8-43cb-8fc6-6a1b1105c852 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.777993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea0140-1b37-459b-86c3-0aa6c7129825 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.778107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57873b2-f8e8-43cb-8fc6-6a1b1105c852 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.778296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57873b2-f8e8-43cb-8fc6-6a1b1105c852 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.779469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 160/327] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:10:58.782243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57873b2-f8e8-43cb-8fc6-6a1b1105c852 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:58.815838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.816447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.816724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.816992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.817723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] RBAC: Adding query filter params (role.id=ebb27a0ec3414c02a06b80ab33da6e0b, user.id=b0ea806163b64240af3c3ad4ad642ff5, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:58.818029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:58.819487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223d635-cd44-49ad-bb91-6c1ea7102a10 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:58.831320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 168/328] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Sep 9 13:10:58 2022] GET /identity/v3/role_assignments?user.id=b0ea806163b64240af3c3ad4ad642ff5&scope.system=all&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:58.832539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.832827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.833107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.852608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:10:58.853868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:10:58.899032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57873b2-f8e8-43cb-8fc6-6a1b1105c852 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:58.922155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:58.933037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 169/329] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:10:58.938989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:58.939614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:58.939898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:58.940717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] PATH_INFO: `/v3/groups` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:58.941368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:58.942865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:58.963358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 161/330] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Sep 9 13:10:58 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:10:59.205341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:59.254174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:59.312326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9e6c-0f60-424a-89e1-fcf6705ecf5c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:59.352394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:59.353275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:59.353715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:59.354926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:59.366473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:10:59.371398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:10:59.372246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:10:59.373058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 170/331] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:10:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:10:59.380631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:59.489159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078392-d4ac-40ec-abee-825958a547e3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:59.527962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:59.528620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:59.528906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:59.529182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:59.529862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:10:59.530169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:59.531649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:59.541191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 162/332] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:10:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:10:59.546674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:59.664693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbfa1-7bf1-449e-acc4-88726d819c7c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:59.672925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:59.705049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:59.705820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:59.706206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:59.706569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] PATH_INFO: `/v3/users/142ff2921c6f40c389966473e23139d5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:59.707758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] RBAC: Authorizing `identity:get_user(user_id=142ff2921c6f40c389966473e23139d5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:59.709194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad0d3-88b4-4583-919f-afd81d026365 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:59.711119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 171/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:10:59 2022] GET /identity/v3/users/142ff2921c6f40c389966473e23139d5 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:10:59.717870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:10:59.779877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:10:59.849120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e81e-9658-4bf2-bd22-dcf4be7dbf71 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:10:59.890579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:10:59.891252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:10:59.891534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:10:59.891811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] PATH_INFO: `/v3/system/users/142ff2921c6f40c389966473e23139d5/roles/caeac9cc26f74ce18e08c111af67b330` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:10:59.893978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=142ff2921c6f40c389966473e23139d5, role_id=caeac9cc26f74ce18e08c111af67b330)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:10:59.895415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1985e0-d3a1-4055-968c-3f9448cb7c54 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:10:59.905882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 163/334] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Sep 9 13:10:59 2022] PUT /identity/v3/system/users/142ff2921c6f40c389966473e23139d5/roles/caeac9cc26f74ce18e08c111af67b330 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:01.630721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f11-c8ea-414e-ba5d-e620af78d2e8 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:01.631247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f11-c8ea-414e-ba5d-e620af78d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:01.631247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e243f11-c8ea-414e-ba5d-e620af78d2e8 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:01.632962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 172/335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:01.639154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:01.639587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:01.639697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:01.663331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:01.664556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:01.708279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a84f8-3b9e-4db0-af06-ea33e0809f68 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:01.708660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a84f8-3b9e-4db0-af06-ea33e0809f68 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:01.709046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a84f8-3b9e-4db0-af06-ea33e0809f68 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:01.710629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 173/336] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:01.719117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:01.719400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:01.719677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:01.741720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:01.742996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:01.764325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 164/337] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:01.830056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 174/338] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:02.122326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.164333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:02.246534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cd3f9-185b-4e56-be25-bb0bfaf9909f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.255565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.318053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.319102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.320056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.320536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.338585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:02.346113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:02.347889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:02.348660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:02.351520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 165/339] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:02.357257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.395100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeaab2-5dfd-4d0f-8754-c41b45ef29d6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.398639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:02.438288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.439077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.439689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.439958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.460819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:02.472967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:02.473912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:02.474720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:02.481143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 175/340] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:02.496289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.556065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:02.564370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bd48-cb12-41a0-8b5d-602206a8286c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.622103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3748b-3156-4968-9dfe-79665116d17c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.658057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.658612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.659437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.662247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.662247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:02.662436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.662806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:02.662878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.662878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.662878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.663062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:02.663135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:02.663135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:02.664198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:02.674177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 176/341] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:02.681265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.682390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 166/342] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:02.687953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:02.718028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:02.816759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d7058-ff46-448d-9b79-007ff5ecfec2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.894395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.894905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.895185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.895519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.925586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e4ad8-4d3e-45c2-bf83-aa45f2cb8c4f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:02.964025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:02.964970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:02.965463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:02.965921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:02.990459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:02.992616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a9dd8-d01a-4b93-b662-6fac25729b68 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.003274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.035364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.064044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.066161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a293b-6ec6-4cc2-ad0b-862f7e48d958 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.134290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:03.135934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58243-ff58-4a60-a5a4-3bbe93d7443c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.136573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58243-ff58-4a60-a5a4-3bbe93d7443c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.138507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58243-ff58-4a60-a5a4-3bbe93d7443c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.140259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 178/344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:03.141467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ce40-01c7-40e7-b698-9fbed858f15b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.141759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ce40-01c7-40e7-b698-9fbed858f15b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.142314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7ce40-01c7-40e7-b698-9fbed858f15b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.146127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 179/345] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:03.146415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ce40-01c7-40e7-b698-9fbed858f15b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.188045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 167/346] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 13:11:03.192340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3be83-9455-4760-a5a4-6232e561dab3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.192910 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3be83-9455-4760-a5a4-6232e561dab3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.193378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3be83-9455-4760-a5a4-6232e561dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.213353 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-78c3be83-9455-4760-a5a4-6232e561dab3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:03.215250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-78c3be83-9455-4760-a5a4-6232e561dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:03.272979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7ce40-01c7-40e7-b698-9fbed858f15b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:03.275607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.291698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 168/347] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:03.293284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.293762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.294286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.308630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.318617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:03.319029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:03.319253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.319542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.319801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.320964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.321471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:03.322433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.324388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 180/348] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:03.327018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.418608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 169/349] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:03.419890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.523444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a1952-8a88-4fb5-bd13-df823c21bac3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:03.556774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787c724-3202-41ce-a5bc-ce886d7eee7d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:03.603305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.608562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:03.609210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.609571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.609841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.612095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.613558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.620446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 181/350] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:03.627279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.650646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:03.651713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.652183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.652702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.663522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.665777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.668060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 170/351] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:03.674961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.757956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:03.830276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036f06d-bc1d-49ed-9405-60bd48fe99b4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:03.848265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d68bb-f34d-416f-9cc5-634b26dc86bb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:03.878573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:03.879212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.879544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.879810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.881367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.882837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.884414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 182/352] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:03.889250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.889893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:03.890540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:03.890819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:03.891091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:03.891822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=4daea584bc4443619716d7ba810e67be) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:03.892127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:03.894871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:03.903331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 171/353] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:03.904443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:03.981997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.012734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4f7ac-d924-4722-93d2-89da0334b61e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.055355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.062483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b3b76-3074-4dc5-8567-909899aa4213 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.064175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.064834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.065758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.066038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.083741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6c630c92-6cb7-49bc-9655-ea85951bff8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:04.088804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:04.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:04.090666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 183/354] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:04.091596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8857-67fb-4fe4-af87-2dfd85581088 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.091878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8857-67fb-4fe4-af87-2dfd85581088 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.092151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb8857-67fb-4fe4-af87-2dfd85581088 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.094192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 184/355] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:04.099384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb8857-67fb-4fe4-af87-2dfd85581088 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.119171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.119171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.119171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.119171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.135360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-09572a3c-4cc7-43fa-a3ed-9071544741fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:04.140745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:04.141639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:04.142526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 172/356] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:04.143238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5908ab-eb0d-4b80-b1f1-155ea8c26a82 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.147762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5908ab-eb0d-4b80-b1f1-155ea8c26a82 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.147762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5908ab-eb0d-4b80-b1f1-155ea8c26a82 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.147762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 173/357] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:04.150915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.151201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.151472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.170334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:04.171536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:04.229380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb8857-67fb-4fe4-af87-2dfd85581088 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.261873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 174/358] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:04.262975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.271604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.272208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.272485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.272751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.273473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=4daea584bc4443619716d7ba810e67be) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:04.273777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:04.275218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:04.280885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 185/359] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:04.281685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.318836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.401061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de790a-7253-4beb-9820-2ebd54d3eab1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.442545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.443565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.444272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.444557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.444829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.445505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:04.445804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:04.447703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0ba92-4d5e-4a07-9549-081149da08b2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:04.458175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 175/360] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:04.459474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.459756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.460255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.486314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:04.488674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:04.555651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153109b-39d9-4bd0-8c87-21c0363b3079 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.581421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:04.582895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.606242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.606874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.607155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.607430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.608160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:04.608466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:04.610083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:04.620753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:04.621409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.633683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.733333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9539f-d036-4810-9aea-5b3628b98d23 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.751748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.766472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd181-f5b3-4d85-aa83-361652ced35c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.772698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.773345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.773622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.773897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.787895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:04.794422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:04.795397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:04.796603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 187/363] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:04.797246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:04.833333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.834509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.835266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.835757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:04.935492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0d93a-ac30-4445-9f18-257d621be7da None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:04.942019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:04.943653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:04.980461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:04.985985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:04.986589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:04.986924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:04.987703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.045898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.079092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.080561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.090397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 177/364] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:05.091998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.202367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 188/365] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:05.203273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.224736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577385-5e1b-4e8a-bdd3-fbfeeeb8ee33 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.260513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.272185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.273623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.274093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.274778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.275590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:05.276288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.278565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.290443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 178/366] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.292090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.306931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.337716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02deec5-b020-4cdf-bf05-0e80be546980 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.390529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.391994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.392275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.392547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.395165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.396622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.399116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 189/367] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.399908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.435162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439dfea-1981-4b51-b631-513d032bf52d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.486127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.486821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.487143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.487574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.498847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:05.507218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:05.508352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:05.509292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 179/368] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:05.510048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.533048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157e025-3f20-44c6-b4ad-2a5a43677c8d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.567513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.571514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.572763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.572763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.573009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.574396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.576101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.577956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 190/369] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.578881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.595977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.627366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbba581-7af7-425d-9b57-823f1a248d56 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.665440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.666358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.666867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.667373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] PATH_INFO: `/v3/users/142ff2921c6f40c389966473e23139d5` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.668642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=142ff2921c6f40c389966473e23139d5)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.670328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.672025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 180/370] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/users/142ff2921c6f40c389966473e23139d5 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.673043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.718341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635e58-1661-4cc8-bf06-1a1f59fea6d5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.759401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.760032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.760306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.760574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.761691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.763165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.764730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 191/371] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.765466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.813305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfedeb5-4f50-4921-8645-dd0e4cf22fb3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.838608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.861201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:05.862942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.864507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.864507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.864507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.864963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:05.865274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.867218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.884958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 181/372] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.886013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:05.897447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b4d4c-7650-4583-9465-b2c72979b626 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:05.950310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:05.950310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:05.950310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:05.950310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:05.950667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:05.951118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:05.957496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 192/373] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:05.958395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:06.026924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db3ec-b122-4105-a1d2-8e2d81f7054d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.067598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.068180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.068463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.068730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.069509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] RBAC: Adding query filter params (role.id=caeac9cc26f74ce18e08c111af67b330, user.id=142ff2921c6f40c389966473e23139d5, scope.system=all) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:06.069816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.071365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.086412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 182/374] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/role_assignments?user.id=142ff2921c6f40c389966473e23139d5&scope.system=all&role.id=caeac9cc26f74ce18e08c111af67b330 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:06.087083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:06.106735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ef235-d8fe-46d1-8aca-ea871940298a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.137149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:06.165059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.165677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.165948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.166255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.166981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=bd125161f0bb49bcb2817c240999f774) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:06.167325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.170363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.185380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 193/375] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:05 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:06.186096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:06.215670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:06.255150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb151d2-460a-4bc4-a753-880425059c6c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.306503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.307135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.307414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.307683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.405252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31418e0c-0908-4b69-9f9c-8fbbe654234f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.413119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.414699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ec3c8-250a-4a94-abc9-4844cec82d4d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.471143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.472314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.472589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.472854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.473593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=bd125161f0bb49bcb2817c240999f774) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:06.473893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.476834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.491092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 194/376] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:06 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:06.494510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:06.584572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 183/377] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:06.590634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:06.664773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba5d8-21e4-4805-a8c9-514483c03de5 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.665075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba5d8-21e4-4805-a8c9-514483c03de5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.665403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcba5d8-21e4-4805-a8c9-514483c03de5 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.667269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 184/378] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:11:06.674169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.675175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.675457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.687483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:06.716637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cd07a-63a7-46ad-aa30-7a455ad7a394 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.719359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:06.720587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:06.759897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.759897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.760229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.760604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] PATH_INFO: `/v3/projects/7416d42f68304327bdde9d1c2d38a108` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.761955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] RBAC: Authorizing `identity:get_project(project_id=7416d42f68304327bdde9d1c2d38a108)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.765960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.765960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 195/379] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:06 2022] GET /identity/v3/projects/7416d42f68304327bdde9d1c2d38a108 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:06.770855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:06.866410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 185/380] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:06.926116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c0d5-6e6f-42c9-9456-f6b5b963f36c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:06.971934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:06.972813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:06.973270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:06.973704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] PATH_INFO: `/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:06.980319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d313db73f14c94bb0ee1ebaac2b386)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:06.982057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b71371-979d-474b-b25d-9da5c8ef9b77 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:06.984233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 196/381] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:06 2022] GET /identity/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:06.990355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:07.087514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:07.133977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2019-9771-4ebb-a53b-c9926af28e86 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:07.188243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:07.189149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.189585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.190683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.191743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] RBAC: Adding query filter params (group.id=c1d313db73f14c94bb0ee1ebaac2b386, role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=7416d42f68304327bdde9d1c2d38a108) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:07.192218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:07.193814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37e4b5-8ff1-4421-aa79-c05a6f9e5152 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:07.202499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 186/382] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:06 2022] GET /identity/v3/role_assignments?group.id=c1d313db73f14c94bb0ee1ebaac2b386&scope.project.id=7416d42f68304327bdde9d1c2d38a108&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:07.254857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9b0f-c7c0-4ef7-96d5-6a62a7016f42 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.255305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9b0f-c7c0-4ef7-96d5-6a62a7016f42 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.255682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc9b0f-c7c0-4ef7-96d5-6a62a7016f42 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.257411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 197/383] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:07.263565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.264084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.264525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.287867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:07.289406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:07.302810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc9b0f-c7c0-4ef7-96d5-6a62a7016f42 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:07.318581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:07.439417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 187/384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:07.479666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc9b0f-c7c0-4ef7-96d5-6a62a7016f42 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:07.521267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:07.521908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.522269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.522549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.535434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:07.540644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:07.541561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:07.542416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 198/385] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:07.548130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:07.615877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:07.668040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a8328-617e-40ba-88d1-1f7d3f484bfc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:07.711759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:07.712289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.712565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.712833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.713493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:07.713789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:07.715173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:07.729491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 188/386] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:07.735420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:07.779834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:07.862687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:07.926106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be8007-f730-424a-a47d-102ce276ba27 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:07.969937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a72c-51d3-45d9-bdac-c0b6c1e526fb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:07.993584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:07.994265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:07.994524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:07.994797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:07.997027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:07.998602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.005048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 199/387] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:07 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:08.007203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.020011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:08.039340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.039976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.040255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.040527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.063591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:08.071377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:08.072339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:08.073118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:08.074251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 189/388] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:08.085833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.192850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d121c-d114-4191-a932-aabe51b0d981 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.238995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.239640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.239917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.240190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.242375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.245632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.247698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 200/389] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:08 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:08.255136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.261211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:08.290115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1522-e3e3-4649-9fc6-989a33da49a0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.346064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.347633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.348190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.348730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.349600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:08.350106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.351715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.362447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 190/390] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:08.367970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.447319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da8406-e2e6-4038-85ef-a8ae6ddd72c5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.466813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:08.528171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.528171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.528171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.528171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.538759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, group_id=cf7c2051eab449b0adfb1e327bde5445, role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.540231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.541908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c95a3-bdbc-4407-a5e5-0f99845446fa None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.574248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 201/391] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Sep 9 13:11:08 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ee3812bbf20246aeb58841361e74fe32 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:08.585997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.587110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.587657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.588171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.589774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.591642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.594183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 191/392] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:08 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:08.599599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.676364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:08.726402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab473a34-313c-446e-8d20-900d03cb4ccc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.767261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.767901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.768719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.768997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.770565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.772161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96966159-aa3e-4b24-8212-2820cc257d18 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.773936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 202/393] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:08 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:08.779997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:08.901683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20645-c882-4040-9162-5cc1e5ca4d6c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:08.917252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:08.939644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:08.940417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:08.940699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:08.941123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:08.943266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4daea584bc4443619716d7ba810e67be, group_id=cf7c2051eab449b0adfb1e327bde5445, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:08.944706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05377a9b-f5ba-48c0-a647-32fabfdb6fc2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:08.966521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 192/394] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Sep 9 13:11:08 2022] PUT /identity/v3/projects/4daea584bc4443619716d7ba810e67be/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:09.173899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29197a3-283f-4c05-a0f9-916f1e6ae8f0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:09.174443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29197a3-283f-4c05-a0f9-916f1e6ae8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:09.174443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29197a3-283f-4c05-a0f9-916f1e6ae8f0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:09.176078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 203/395] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:09.182472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92df7c-6cc7-490e-b3f9-447e1318b768 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:09.182912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92df7c-6cc7-490e-b3f9-447e1318b768 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:09.182995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92df7c-6cc7-490e-b3f9-447e1318b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:09.204452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ed92df7c-6cc7-490e-b3f9-447e1318b768 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:09.205672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ed92df7c-6cc7-490e-b3f9-447e1318b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:09.282264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 193/396] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:09.414709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49ea2-0892-42d2-bf04-b0a5724d916e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:09.414994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49ea2-0892-42d2-bf04-b0a5724d916e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:09.415273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e49ea2-0892-42d2-bf04-b0a5724d916e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:09.416864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 204/397] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:09.423766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:09.424114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:09.424345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:09.443467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:09.444666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:09.517814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 194/398] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:09.583140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e49ea2-0892-42d2-bf04-b0a5724d916e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:09.716680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e49ea2-0892-42d2-bf04-b0a5724d916e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:09.756383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:09.762636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:09.763270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:09.763544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:09.763815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:09.779511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:09.784899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:09.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:09.786586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 205/399] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:09.792126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:09.833274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:09.852536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:09.985147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcbe07-e03c-4f41-82a6-48c89f060e75 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:09.996626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f5db-e3fc-4fe8-9e66-5929b9e05a8c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.052931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.053560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.054745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.055031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.055741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:10.056760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.058197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.063782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.064432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.064708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.064975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.076414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 195/400] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:10.082809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.088576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:10.094203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:10.095207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 206/401] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:10.101292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.188168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:10.236163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:10.247146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a44af-9b5b-4228-a7f0-619c466a9142 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.247370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc14e-5f6c-4eb1-bdcf-6ba8447fad32 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.289498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.290165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.290470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.290736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.291550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:10.291950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.293103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.293332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfa9ce-1c9b-4188-b1e5-d68af8afb095 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.294136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.294843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.295711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.297083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.299520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.302033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 196/403] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:10.302252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 207/403] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:10.303605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10d95-8629-4ac7-8b84-a06a41319cf2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.303889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10d95-8629-4ac7-8b84-a06a41319cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.304160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10d95-8629-4ac7-8b84-a06a41319cf2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.305541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 208/404] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:10.307705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.310473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10d95-8629-4ac7-8b84-a06a41319cf2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.430844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7eb304-aaca-4e86-8253-0f7c4719f1a6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.440557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10d95-8629-4ac7-8b84-a06a41319cf2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.456956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:10.469553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.470510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.470968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.471969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.473288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.474949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61364e-0914-4db1-9c88-529cda92bcda None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.477063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 197/405] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:10.478488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.478949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.479406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.481831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.482661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.482945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.483296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.484397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.485928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.488043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 209/406] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:10.489302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.500218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:10.501663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:10.529386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:10.577749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 198/407] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:10.579065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.642256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2d621-77f0-4f74-8d08-1e067eb5a26f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.714119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.715343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.716456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.717089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.722422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, group_id=cf7c2051eab449b0adfb1e327bde5445, role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.725262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.731823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6babf79-2273-4ddc-a9f7-d6d6f51e8622 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.750690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 210/408] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Sep 9 13:11:10 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ee3812bbf20246aeb58841361e74fe32 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:10.784236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.784879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.785214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.785493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.786676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.788436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.790722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 199/409] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:10.796957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:10.858531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:10.930373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74014-cea8-44b7-9b10-7426d3d93663 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:10.977076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:10.977761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:10.978042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:10.978342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:10.982425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd125161f0bb49bcb2817c240999f774, group_id=cf7c2051eab449b0adfb1e327bde5445, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:10.984095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:10.992436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:11.000629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 211/410] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Sep 9 13:11:10 2022] PUT /identity/v3/projects/bd125161f0bb49bcb2817c240999f774/groups/cf7c2051eab449b0adfb1e327bde5445/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:11.037253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:11.131298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded5087-73bc-46ba-8c1b-674b6b9d4910 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:11.177072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:11.178148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.178651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.179167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.197360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:11.203245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:11.204200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:11.204975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:11.208087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 200/411] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:11.213479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:11.324593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb326b8-a713-4d2c-b8e9-57bf626f03c6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:11.327894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:11.371775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:11.372767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.373261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.373744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.374645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:11.375204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:11.376814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:11.389631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 212/412] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:11.395706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:11.503172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:11.513609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dcb19-935a-4feb-8d77-0c0282c4d5f6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:11.551564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:11.552277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.552570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.552845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] PATH_INFO: `/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.554089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d313db73f14c94bb0ee1ebaac2b386)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:11.555627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b49d8d-ef2d-440f-88f4-8bd07a749d94 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:11.557673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 201/413] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:11 2022] GET /identity/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:11.563230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:11.696806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582c963-32e8-40a9-853f-5b8fcec12fdf None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:11.716222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea2300-501c-4101-9a67-4cb6c221d551 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.716549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea2300-501c-4101-9a67-4cb6c221d551 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.716778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea2300-501c-4101-9a67-4cb6c221d551 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.718478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 202/414] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:11:11.724193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3bfa3-13d0-45d6-bc58-c6d07a8c1745 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.724482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3bfa3-13d0-45d6-bc58-c6d07a8c1745 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.724760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3bfa3-13d0-45d6-bc58-c6d07a8c1745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.740815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:11.741465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.741733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.742002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] PATH_INFO: `/v3/projects/7416d42f68304327bdde9d1c2d38a108` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.743168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] RBAC: Authorizing `identity:get_project(project_id=7416d42f68304327bdde9d1c2d38a108)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:11.744597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77296997-0b81-44ef-88e9-bb2887e67c63 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:11.745584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b6d3bfa3-13d0-45d6-bc58-c6d07a8c1745 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:11.746593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 213/415] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:11 2022] GET /identity/v3/projects/7416d42f68304327bdde9d1c2d38a108 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:11.747105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b6d3bfa3-13d0-45d6-bc58-c6d07a8c1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:11.747814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e4e8-7193-4912-ac78-3ed3fe7bbd5a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.748103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e4e8-7193-4912-ac78-3ed3fe7bbd5a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.748371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e4e8-7193-4912-ac78-3ed3fe7bbd5a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.754313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 214/416] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:11.755130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e4e8-7193-4912-ac78-3ed3fe7bbd5a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:11.790818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:11.841700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 203/417] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:11.843318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.843760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.844176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.863509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:11.865031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:11.891087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e4e8-7193-4912-ac78-3ed3fe7bbd5a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:11.954655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 204/418] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:11.956933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:11.957765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:11.958264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:11.958711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] PATH_INFO: `/v3/projects/7416d42f68304327bdde9d1c2d38a108/groups/c1d313db73f14c94bb0ee1ebaac2b386/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:11.960925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] RBAC: Authorizing `identity:create_grant(project_id=7416d42f68304327bdde9d1c2d38a108, group_id=c1d313db73f14c94bb0ee1ebaac2b386, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:11.962527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:11.979796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 215/419] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Sep 9 13:11:11 2022] PUT /identity/v3/projects/7416d42f68304327bdde9d1c2d38a108/groups/c1d313db73f14c94bb0ee1ebaac2b386/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:12.186031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.205424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:12.288611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.293573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51a8c-e344-40bb-803e-29cf670581d1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:12.331019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:12.331656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:12.331935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:12.332734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:12.345850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:12.353161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:12.354016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:12.354828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:12.355563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 205/420] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:12.360476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.395503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:12.419746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd796fe-5937-4fc0-bc68-7a1a7b449625 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:12.466930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:12.491292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c86d-5643-488b-9033-984a0c14203c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:12.499695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:12.500465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:12.500746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:12.501017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:12.522180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:12.527898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:12.528737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:12.529519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:12.532979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:12.534479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:12.535256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 216/421] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:12.535786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:12.536249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:12.537111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:12.537602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:12.539203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:12.541081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.557453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 206/422] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:12.563244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.715352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006ce29-6b05-4cb3-a3f8-da6775d3627e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:12.761294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5419-6806-45ee-a445-47c288972efd None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:12.799056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:12.799256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:12.799806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:12.800089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:12.800365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:12.800845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:12.801034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:12.801344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:12.801685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:12.802136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:12.802770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:12.818686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 217/423] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:12.822544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:12.824271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:12.858124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:12.929979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:12.934458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.036568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65d79f-337f-4424-abb4-99d853fa1b87 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.108880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.109520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.109796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.110065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.136675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 207/424] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:13.142758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.226294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.250523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.251981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.274051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.355486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13df2-9bd1-4c42-9ab7-9cd3c03bb313 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.439421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.442359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.442878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.443350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.445538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.448300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.453302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 218/425] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:13.454169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 208/426] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:13.458904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.459986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.598332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a8d0e-8bf6-4087-9517-a8de84887fe6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.599462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb06f4-586a-46d2-a2d6-490ee2c9f6c2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.613754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.614725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.637521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.638377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.638717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.639060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] PATH_INFO: `/v3/projects/4daea584bc4443619716d7ba810e67be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.640352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] RBAC: Authorizing `identity:get_project(project_id=4daea584bc4443619716d7ba810e67be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.642335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd573b-7778-4766-9520-a4fa671e414c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.643838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.644082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.644366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.644544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 219/427] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/projects/4daea584bc4443619716d7ba810e67be => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:13.644622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.645696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6420-2896-48c0-ab61-b6dcafff9efa None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.646009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6420-2896-48c0-ab61-b6dcafff9efa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.646248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b6420-2896-48c0-ab61-b6dcafff9efa None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.647485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 220/428] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:13.650604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.650724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b6420-2896-48c0-ab61-b6dcafff9efa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.652064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05574e-0a1c-4bb1-9d47-5940f08f343d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.654025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 209/429] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:13.659975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.660260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.660670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.680729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:13.682079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:13.776407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 210/430] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:13.777078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.778553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b6420-2896-48c0-ab61-b6dcafff9efa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.853103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.853742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.854014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.854307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.855405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.856824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7e97-99d8-4ed5-8bab-434c0740467f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.858666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 221/431] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:13.859791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7257a-daed-44a4-952f-5f83404faadf None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.860062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7257a-daed-44a4-952f-5f83404faadf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.860329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7257a-daed-44a4-952f-5f83404faadf None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.866261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 222/432] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:13.867002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7257a-daed-44a4-952f-5f83404faadf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:13.931353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.932468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231aeeef-8312-4bad-8ceb-a989bf23add5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:13.942959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:13.973285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:13.974517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.975029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.975503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.976496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=4daea584bc4443619716d7ba810e67be) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:13.977007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:13.978803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362269f8-1736-4f70-bf4e-d35781678300 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:13.985931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 211/433] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:13.988457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:13.988970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:13.989446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:13.991306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7257a-daed-44a4-952f-5f83404faadf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.012356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:14.013916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:14.035760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.036373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.036645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.037108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.037985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=4daea584bc4443619716d7ba810e67be) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:14.038475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:14.040567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:14.050577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 223/434] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:13 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=4daea584bc4443619716d7ba810e67be&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:14.077152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.154382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 212/435] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:14.219657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ce0e9-c0c4-488a-b6df-4f3918cad6b7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.242681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.258859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.259517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.259798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.260071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.272506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:14.278298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:14.279270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:14.280287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 224/436] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:14.286080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.418416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.421732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a00f-73e4-40fd-a0ce-0ec44a72ac85 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.445783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.461872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.463175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.463175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.463420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.464033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:14.464337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:14.466544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:14.478895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 213/437] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:14.484836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.584481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839524f-aa73-41a4-a7e0-e2c8c8e216a2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.599886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67144166-7f5c-4b13-bcfd-a8f2d4844127 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.625712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.626793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.627069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.627342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.637879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.638521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.638799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.639345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.641973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d75ce66a-8cee-4c4e-a4b0-a445e4483666 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:14.648279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:14.649175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 13:11:14.649983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:14.650891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 225/438] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:14.652297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e100f-31b1-41e8-b132-0c557baf0f9a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.652796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e100f-31b1-41e8-b132-0c557baf0f9a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.653268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e100f-31b1-41e8-b132-0c557baf0f9a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.655258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 226/439] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:14.659797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e100f-31b1-41e8-b132-0c557baf0f9a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.675942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.702609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.728559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:14.730267 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:14.782292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e100f-31b1-41e8-b132-0c557baf0f9a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.816535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.817147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.817426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.817699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.818397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:14.818704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:14.820113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23f7d9-b6d8-45c0-b645-94dc0370edf8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:14.831903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 227/440] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:14.833460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.833741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.834074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:14.843697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 214/441] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:14.844536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.855199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:14.856403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:14.903992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.920461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 228/442] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:14.921618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:14.946158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400eb37-c096-42b9-bbbe-b97b557e182b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:14.956674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:14.981626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:14.982239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:14.982541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:14.982817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.037973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b42a3-e703-456d-8fe3-bde786a12b86 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.056999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.058488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.075208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.076030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.076372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.076647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.077757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.079187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.081180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 229/443] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:15.086400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.125165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.168610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 215/444] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:15.174645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.182756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.191261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fd239-1605-4da8-85b0-f6f9784cdcc0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.224464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.225008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.225280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.225545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.226792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.228221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.229762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 230/445] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:15.234729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.274717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eeeb0-50cb-4b84-8144-637344946bc0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.307589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.308275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.308557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.308855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] PATH_INFO: `/v3/projects/bd125161f0bb49bcb2817c240999f774` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.309975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] RBAC: Authorizing `identity:get_project(project_id=bd125161f0bb49bcb2817c240999f774)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.311455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.313067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 216/446] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/projects/bd125161f0bb49bcb2817c240999f774 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:15.319127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.331644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e94822-e769-4411-8b22-dfb93d535810 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.349271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.364885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.365515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.365796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.366071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.376261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:15.381865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:15.382827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:15.383669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 231/447] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:15.384407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.408147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.420447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac61d-1e55-43e0-969e-1be58d481d6d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.453822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.454451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.454734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.455011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.456441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=bd125161f0bb49bcb2817c240999f774) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:15.456758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.458191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.464368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 217/448] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:15.465147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.484107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced6290-7c4e-43f4-950a-abfe204d3e74 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.522886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.523534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.523811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.524083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] PATH_INFO: `/v3/groups/cf7c2051eab449b0adfb1e327bde5445` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.525293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] RBAC: Authorizing `identity:get_group(group_id=cf7c2051eab449b0adfb1e327bde5445)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.526825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.528541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 232/449] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/groups/cf7c2051eab449b0adfb1e327bde5445 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:15.535067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.579002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.586481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a65b0-cf2b-422a-a2fc-6814fbd20649 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.624812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.625503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.625726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.625955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.626655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:15.626954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.628986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.638841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 218/450] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:15.643522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.644304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:15.659562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc26-b07f-4ade-8e67-004bb8eba619 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.705222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.705895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.706321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.706603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.707331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] RBAC: Adding query filter params (group.id=cf7c2051eab449b0adfb1e327bde5445, role.id=ebb27a0ec3414c02a06b80ab33da6e0b, scope.project.id=bd125161f0bb49bcb2817c240999f774) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:15.707635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.709056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.714830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 233/451] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/role_assignments?group.id=cf7c2051eab449b0adfb1e327bde5445&scope.project.id=bd125161f0bb49bcb2817c240999f774&role.id=ebb27a0ec3414c02a06b80ab33da6e0b => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:15.759538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a555-bbf3-4f22-bf34-55ee0e346829 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:15.795392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:15.796012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:15.796292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:15.796565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:15.824660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:15.871217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:15.872695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:15.971716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 13:11:15.977346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:16.078937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4287-c1e8-43ee-a449-75efcdd9bd8c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:16.112926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:16.113561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:16.113840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:16.114112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] PATH_INFO: `/v3/projects/7416d42f68304327bdde9d1c2d38a108` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:16.115272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] RBAC: Authorizing `identity:get_project(project_id=7416d42f68304327bdde9d1c2d38a108)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:16.116696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:16.118517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 234/453] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:11:15 2022] GET /identity/v3/projects/7416d42f68304327bdde9d1c2d38a108 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:16.123870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:16.181151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:16.228122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6e97-ec57-4483-acb8-4cedf652bc40 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:16.262358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:16.262980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:16.263262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:16.263538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] PATH_INFO: `/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:16.264627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] RBAC: Authorizing `identity:get_group(group_id=c1d313db73f14c94bb0ee1ebaac2b386)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:16.266057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee9cc6-5940-4937-a539-124db9409cea None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:16.267645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 220/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Sep 9 13:11:16 2022] GET /identity/v3/groups/c1d313db73f14c94bb0ee1ebaac2b386 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:16.273827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:16.297615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:16.371139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c356ea-806a-4f85-a620-2f028e9741dd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:16.403042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:16.403629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:16.403902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:16.404169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:16.404879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] RBAC: Adding query filter params (group.id=c1d313db73f14c94bb0ee1ebaac2b386, role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=7416d42f68304327bdde9d1c2d38a108) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:16.405181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:16.406617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e8244-4345-466e-b456-319cab099dd3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:16.412247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 235/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Sep 9 13:11:16 2022] GET /identity/v3/role_assignments?group.id=c1d313db73f14c94bb0ee1ebaac2b386&scope.project.id=7416d42f68304327bdde9d1c2d38a108&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:19.105731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f78f9-e018-447e-8069-1eaa51f60219 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.106759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f78f9-e018-447e-8069-1eaa51f60219 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.107258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f78f9-e018-447e-8069-1eaa51f60219 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.109103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 221/456] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:19.115715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.116202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.116291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.139333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:19.140587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:19.217116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743347f4-9f39-4c5e-b91e-7615b8415306 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.217449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743347f4-9f39-4c5e-b91e-7615b8415306 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.217672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743347f4-9f39-4c5e-b91e-7615b8415306 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.219352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 222/457] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:19.224972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69da8b-1bb1-4297-8c1b-f392b72c1012 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.225259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69da8b-1bb1-4297-8c1b-f392b72c1012 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.225523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69da8b-1bb1-4297-8c1b-f392b72c1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.228335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 236/458] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:19.263227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8a69da8b-1bb1-4297-8c1b-f392b72c1012 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:19.264433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8a69da8b-1bb1-4297-8c1b-f392b72c1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:19.364856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 223/459] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:19.555391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:19.579251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:19.668212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be56dc-1d7b-4c92-bd4f-ed675ab310b7 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.668895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be56dc-1d7b-4c92-bd4f-ed675ab310b7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.669481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be56dc-1d7b-4c92-bd4f-ed675ab310b7 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.671061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 224/460] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:11:19.677527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.678150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.678669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.678907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49b6b0-b1eb-4a63-92c6-234b8a675b3d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:19.697545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:19.699116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:19.745444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:19.746089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.746408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.746683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.757736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:19.759326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:19.770399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:19.776375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:19.777283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:19.778120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:19.778120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:19.778120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:19.779840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 237/461] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:19.780763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:19.796297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 225/462] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:19.802277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:19.916357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:19.929493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679471d2-dd5a-4349-b755-51c5bc608983 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:19.964782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:19.965394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:19.965675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:19.965947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:19.966633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:19.966936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:19.968311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:19.970998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64c5ca-6abb-41c2-906a-40ac7fbda903 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:19.987716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 226/463] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:19.993136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.042802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.059059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.059698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.060030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.060311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.072249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.073701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-27d1591c-96b3-449b-a83a-17c7ca6035eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:20.089504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:20.090432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:20.091253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:20.091253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.091253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:20.091253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 238/464] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:20.092409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55429-2e76-443e-a9c7-2a2a5ccf7d6b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.092811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55429-2e76-443e-a9c7-2a2a5ccf7d6b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.093099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55429-2e76-443e-a9c7-2a2a5ccf7d6b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.102291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 239/465] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:20.103167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab55429-2e76-443e-a9c7-2a2a5ccf7d6b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.107339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e1d3-3a57-4716-ba4f-2b7a2a0f17a6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.144524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.145129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.145405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.145674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.146351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.147793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3eff9-1c66-4adc-965b-7052161358c6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.170034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 227/466] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:19 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:11:20.171690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.172086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.172434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.196128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:20.197580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:20.235536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab55429-2e76-443e-a9c7-2a2a5ccf7d6b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.265218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.278517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.279252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.279602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.279982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.280699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:20.281099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.282737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.293287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 228/467] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:20.294594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.307171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 240/468] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:20.313943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.350255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.441551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dccc22-5f5c-4681-b2b3-3ea065dec201 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.448838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309003-661f-4ff0-9e3a-7459426c9792 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.488485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.490046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.490536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.491011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.491840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.493459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f27fb-a463-4da9-95ba-e15167e1eb3d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.494517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.495157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.495437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.495709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.509153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.510579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.521582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 241/469] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:20 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:11:20.523688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618111-8390-4e32-b059-326a8389e37d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.524280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618111-8390-4e32-b059-326a8389e37d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.524752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47618111-8390-4e32-b059-326a8389e37d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.526673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 242/470] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:20.531900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.532593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.533041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:20.537184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:20.538069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:20.539139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:20.539139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.539139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:20.543036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 229/471] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:20.545590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.573763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:20.576242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:20.624960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.678132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 243/472] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:20.679367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.680033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.702082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43188996-6f77-4788-9c8d-22f285000e28 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.741183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.741794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.742073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.742377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.743025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:20.743330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.744708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.760072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 230/473] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:20.764502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.838237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0dfad-5f51-467b-b435-0c009cc02798 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.878870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.879522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.879798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.880074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.891855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.894250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.899987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41821d48-8edb-4244-a604-38d66c075892 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:20.912599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:20.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:20.914388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:20.914388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:20.914388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:20.914388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 244/474] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:20.920172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:20.942612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:20.943526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:20.944217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.944808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:20.945247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:20.945904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:20.947408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:20.973959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:20.985796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 231/475] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:20 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:11:21.003995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:21.055112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e9445-1741-4dae-be4b-af5a27948670 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:21.106764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:21.107543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:21.107823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:21.108110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:21.108871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:21.109172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:21.110694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:21.124314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 245/476] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:21.130962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:21.187392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05c5b3-b23e-402b-87ff-0e67741ede65 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:21.228097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:21.228624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:21.228903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:21.229231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:21.229904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:21.231331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:21.240360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.sql.core [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 13:11:21.240360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 13:11:21.240360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [parameters: {'id': '704f7b81e03241bba435106594960f78', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 13:11:21.240360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81444) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 13:11:21.251776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result.read() Sep 09 13:11:21.261660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:11:21.262743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application yield resource Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise self.value Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application session.commit() Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 13:11:21.263762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.session.flush() Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application compat.raise_( Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 13:11:21.264609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:11:21.265430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result.read() Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:11:21.266349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [parameters: {'id': '704f7b81e03241bba435106594960f78', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:21.267187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 13:11:21.268217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.270894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Sep 9 13:11:21 2022] POST /identity/v3/roles => generated 144 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:21.275000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40674c51-b10c-4bbd-86b8-ce11388dffa1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:21.277027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:21.324282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:21.325008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:21.325359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:21.325694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:21.326497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:21.328919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:21.355969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 246/478] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:21 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:11:21.364710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:21.405295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93cd47-7099-40c9-a919-b04917a5f07b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:21.445703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:21.446383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:21.446775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:21.447056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:21.459992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-fac37429-40c1-4d67-87fa-c4c506ba2e64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:21.465355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:21.466302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:21.467203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 233/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:21.472979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:21.614098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ab090-16c5-4f4e-a7c2-6e723ab9c591 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:21.650825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:21.651441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:21.651761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:21.652034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:21.652700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:21.652999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:21.654400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57953ca-8b13-47b5-9962-d40cfd42c9c3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:21.655845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:21.668364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 247/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:22.862932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79b79-bbf4-4365-96fb-bcdf86cd63d4 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:22.863431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79b79-bbf4-4365-96fb-bcdf86cd63d4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:22.863527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f79b79-bbf4-4365-96fb-bcdf86cd63d4 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:22.865128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 234/481] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:22.870472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ee07-17f5-4178-9402-413af3b4b9fb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:22.870899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ee07-17f5-4178-9402-413af3b4b9fb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:22.871068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84ee07-17f5-4178-9402-413af3b4b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:22.889513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1c84ee07-17f5-4178-9402-413af3b4b9fb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:22.890722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1c84ee07-17f5-4178-9402-413af3b4b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:22.992749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:23.333855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceae5-4d5f-4625-b15c-8cc4723cfc52 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:23.334254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceae5-4d5f-4625-b15c-8cc4723cfc52 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:23.336421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceae5-4d5f-4625-b15c-8cc4723cfc52 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:23.338130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 235/483] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:23.345535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:23.345817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:23.346089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:23.370456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:23.371645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:23.410577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ceae5-4d5f-4625-b15c-8cc4723cfc52 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:23.493981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 249/484] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:23.572016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ceae5-4d5f-4625-b15c-8cc4723cfc52 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:23.604950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:23.623055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:23.623685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:23.623964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:23.624237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:23.643916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:23.648585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:23.650751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:23.652793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 236/485] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:23.658387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:23.751756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:23.801634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2369f8-f981-4a8a-bcb7-0b29c17a741f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:23.854029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:23.854678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:23.855012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:23.855226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:23.855897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:23.856198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:23.857566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:23.867274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 250/486] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:23.873491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:23.874786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.021575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea2c0a-83f9-43e4-95a9-55c8891052a7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.022713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f0766-e8c9-44c8-a2ca-b6dbd503ea20 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.043595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.061902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.062573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.062943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.063309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.064299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.065736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.066153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.066976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.074881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.076558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.079048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-74283797-43d4-4b5f-a6e4-5abf9c577db8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:24.085316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:24.086198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:24.087552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 251/487] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:24.093189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b629-bb3f-4525-8afb-ee61f4b4429d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.093189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b629-bb3f-4525-8afb-ee61f4b4429d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.093189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b629-bb3f-4525-8afb-ee61f4b4429d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-8da4b310-81c3-423a-a5fb-0e2736f5ed8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:24.093552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:24.095156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:24.097556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:24.097556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:24.097556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:24.097878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 252/489] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:24.097878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b629-bb3f-4525-8afb-ee61f4b4429d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.102246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 237/489] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:24.102246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.102246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.102246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.121433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:24.122746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:24.157244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.214291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 238/490] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:24.215461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.249053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b629-bb3f-4525-8afb-ee61f4b4429d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.332464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.333094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.333376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.334912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.335308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:24.335614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.340065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.358914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 253/491] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:24.364994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.413590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f0715-26d3-41a7-8952-7a880b0dfe93 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.415198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.454949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.455889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.456167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.456849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.457526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:24.457782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.459797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cbe9d-cc3b-455d-b741-5b2c6a37ecd0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.473664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 239/492] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:24.474983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe583-5e6c-48d2-bbaa-3100e2b619af None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.475272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe583-5e6c-48d2-bbaa-3100e2b619af None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.475550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe583-5e6c-48d2-bbaa-3100e2b619af None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.476892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 240/493] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:24.477899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43ba7-548e-40ca-ab31-ba2e2dba2ec7 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.478478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43ba7-548e-40ca-ab31-ba2e2dba2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.478645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43ba7-548e-40ca-ab31-ba2e2dba2ec7 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.484061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 241/494] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:24.484061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43ba7-548e-40ca-ab31-ba2e2dba2ec7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.491609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852cda-4d12-4781-bdfd-c6e50a1a4b2a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.509312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.527174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.527809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.528090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.528508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.539081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.540521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2f7b0c8e-cc6c-4184-be84-e590403b0120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:24.555121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:24.556245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:24.557098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:24.557098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:24.557098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:24.557098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 254/495] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:24.557303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e5c-64c3-4116-9661-caf6d301ee39 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.557585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e5c-64c3-4116-9661-caf6d301ee39 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.557861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958e5c-64c3-4116-9661-caf6d301ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.575957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-56958e5c-64c3-4116-9661-caf6d301ee39 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:24.577148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-56958e5c-64c3-4116-9661-caf6d301ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:24.589145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43ba7-548e-40ca-ab31-ba2e2dba2ec7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.622469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.623092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.623374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.623648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.630764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.632199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.642854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 255/496] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:24.644771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.645059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.645331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:24.645672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:24.646546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 242/497] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:24.652106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.671007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:24.672113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:24.689013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.741222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 256/498] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:24.742538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.756936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.771935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6d85-c43f-4f7b-84fa-d4a7e9ea41f2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.807641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.808266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.808541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.808810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.825323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:24.833028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:24.833908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:24.834740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:24.836624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 243/499] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:24.837535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.873191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958157c-5947-4501-8c9e-7bfaa61a60b2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.913034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.913674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.913893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.914727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.915378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:24.915675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.917532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:24.932650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 257/500] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:24.933450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:24.941277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d3dbf-1a6c-4211-944b-cbc6cb3a6b8c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:24.951490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:24.978386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:24.978996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:24.979273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:24.979540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:24.980258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:24.980558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:24.981989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.025286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 244/501] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.025286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.025286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.049417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7043eb-5fe7-48f5-bf1b-33632ef6df0f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.083224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.083825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.084098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.084366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.085018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:25.085325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.086724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.094595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 258/502] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.095363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.127432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf43bd7-3b34-4665-a5e2-52717fe7dd44 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.161007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.161638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.161925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.162198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.169787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.173005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:25.178678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:25.179766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 245/503] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:25.180705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.199747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4d394-0ca2-417f-bc59-776dda92ac96 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.232510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.233130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.233406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.233676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.240429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.243212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:25.255337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:25.256257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:25.257112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 259/504] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:25.257642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.285283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757cabd-700c-4305-909d-0c7ebf956568 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.318942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.319542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.319823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.320094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.358125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a43fd-3c43-4b58-869a-2ea217019314 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.390357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.390973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.391252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.391526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.393989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.403812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.405284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.406081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.407541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:25.421985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:25.423047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:25.423908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:25.423908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.423908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:25.427502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 260/505] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:25.427502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.466087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.509838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 246/506] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:25.509838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.530488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1834-9346-4933-a4c9-9dfa26b660ba None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.563330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.564164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.564442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.564718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.574945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.576381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:25.590681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:25.591562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:25.592370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:25.592370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.592370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:25.592370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 261/507] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:25.592585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.608602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807618-2f4f-44bb-aff5-a89fdd7c4191 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.634920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.643107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.644447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.644726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.644998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.645656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:25.645961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.647381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.655093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 247/508] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.655868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.682922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.701266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5adf8-a58b-4cb5-a3f2-e12392f225fd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.734229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.734833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.735110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.735390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.736110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:25.736432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.738564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.756712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3713b-5ec1-4c3e-9109-9050c15cf273 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.774769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 262/509] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.775601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.789481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.790081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.790388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.790655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.791281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:25.791587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.792934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.805114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 248/510] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.805885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.871695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.877676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd21d-4ea4-41fe-9779-2fbdebd435a0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.891779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:25.907347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8593-592f-46a3-a4df-af438fa5664b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:25.911226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.911849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.912126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.912393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.922344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.923817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:25.938999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:25.939893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:25.940843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:25.940843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:25.940843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:25.940843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 263/511] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:25.940843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:25.946765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:25.947372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:25.947653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:25.947923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:25.948558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:25.948860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:25.950272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:25.961620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 249/512] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:25.962452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.043900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27859dd-cabf-4119-91a1-ceb4b25c36cb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.064927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0000-3f39-4bc5-a688-69c8900e6f48 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.078176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.078822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.079099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.079371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.090238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.091682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.098403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.099001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.099278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.099548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.100130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:26.107095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:26.108117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:26.108961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:26.108961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:26.108961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:26.110602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 264/513] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:26.111427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.117948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.170445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.171913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.210332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e341be-bde0-4d1e-b311-8a85455046fc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.243305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.243909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.244193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.244470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.245116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.246572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.267640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 250/514] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:26.268945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 265/515] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:26 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:11:26.273074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.275225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.334442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.347183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.396607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec910a-81d6-46d2-8173-7b7638770178 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.402629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15104bb-ed9b-4d20-9fef-4e452cab1b76 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.435256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.435903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.436153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.436435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.437089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:26.437393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.439166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.445373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.446020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.446406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.447394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.451655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 251/516] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:26.452572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.458994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.460450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:26.472869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:26.473800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:26.474710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 266/517] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:26.475281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.570627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9217f9e-fc4c-4775-acad-461d28b06c21 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.573917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.588984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741acc4-ad52-4962-9f53-317a84d0cd36 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.606304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.608239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.608950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.609203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.609472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.610114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:26.610451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.611827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.628241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 252/518] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:26.628241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.631458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.632098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.632375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.632648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.644002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.645429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:26.661298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:26.662406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:26.663413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:26.663413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:26.663413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:26.663413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 267/519] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:26.667575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.739290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc083258-9faa-4a6c-ad80-935c4bb975c4 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.770129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24fd87-0716-4508-b5c3-edfab1129f01 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.774790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.775499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.775849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.776196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.785381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.786953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:26.798959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:26.800676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:26.801712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:26.802202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 253/520] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:26.803139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.809535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.810151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.810469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.810739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.811472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:26.811779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.814693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.833752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.838675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 268/521] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:26.840165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:26.872369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:26.916161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab23a-82e7-4114-b99e-19a9b7e92e14 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.950934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:26.951568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:26.951830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:26.952106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:26.953302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2644c-7583-484c-92c9-bbaa65821691 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:26.960208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:26.961673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:26.973733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:26.974760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 254/522] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:26.975615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.001829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.002829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.003470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.003891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.005290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:27.005762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.007935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.028025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 269/523] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:27.029468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.065251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.082466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d9e7-f795-461c-b059-f1b539b28fff None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.117256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.117796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.118061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.118367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.119062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:27.119377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.120834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.124135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.139529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 255/524] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:27.140351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.148068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af138e-8fb6-433b-9ef5-e85155920781 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.185981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.186719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.187000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.187274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.252112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975895-0975-43bc-9020-d9d4be1c7687 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.264610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.266080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.288703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.289310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.289614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.289866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.290611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:27.290917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.292355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.311978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 256/525] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:27.312605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.315855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.359585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.378328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 270/526] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:27.379068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.423923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb62f-2a17-4a4c-a75f-6e54d6aab422 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.459072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.459810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.460092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.460366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.467120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.468572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:27.480935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:27.481986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 257/527] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:27.487271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.492687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f95c3c-00e7-4f41-8380-c903e6a9b29a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.531316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.531933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.532212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.532484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.533220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:27.533533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.535628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.550242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 271/528] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:27.550242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.562303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.607668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941cdba-067e-49a7-b25a-404290b5a4e8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.616312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.651072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.651684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.651961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.652282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.689772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1c4aa-df21-41c8-a5af-51f895e2e8a2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.733516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.735049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.746645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.746973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.747356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.749136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.764674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.766125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:27.788151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:27.789126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:27.789954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:27.789954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:27.789954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:27.789954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 272/529] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:27.794247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.807556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.854436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 258/530] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:27.859875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.904982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ef51-5cf8-4512-9227-1cfcc1f37e0b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:27.906470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:27.944382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:27.944992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:27.945271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:27.945542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:27.946501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:27.948447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:27.950141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:27.972387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 273/531] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:27.974649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:27.977028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485545-00c3-4cbc-aa82-741a8efa78eb None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.020860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.021468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.021746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.022014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.022688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:28.022989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.024882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.039927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 259/532] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:28.040787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.075265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.099821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e742c6-9336-4f5a-bef4-b5901a3946e2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.139387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.140467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.140978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.141482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.154455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.157016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.164394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c3ced-1a85-4936-812b-76064d3d6ca7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:28.174823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:28.176009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:28.176850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:28.176850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:28.176850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:28.184100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 274/533] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:28.184100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.207723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.212645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.213520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.214006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.214499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.216132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=55004b070d1e42968d2f8272071034bb) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:28.216894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.219507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.228236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 260/534] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/role_assignments?user.id=55004b070d1e42968d2f8272071034bb&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:28.230366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.303616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3627-ac46-4246-8659-c75f075f87a2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.340921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.341582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.341859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.342133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.350709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.352791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.357004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:28.368666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:28.369741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:28.370822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:28.372933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 275/535] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:28.378911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559bb6-3504-4e05-8400-81f983ee0c2c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.379803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.433108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.433971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.434440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.434852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.435665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:28.436158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.437724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.452122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 261/536] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:28.458431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.497937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.542103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64c9ac-d496-44be-9bba-62df40d02b40 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.585207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.586182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.586583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.586954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.587811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:28.588215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.589866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c6053-560d-43b4-ac55-8c6a70e4e79d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.604144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 276/537] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:28.609000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf690-5fe7-405f-84ad-1eb716d6a8b0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.609000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf690-5fe7-405f-84ad-1eb716d6a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.609000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf690-5fe7-405f-84ad-1eb716d6a8b0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.609000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 277/538] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:28.613238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf690-5fe7-405f-84ad-1eb716d6a8b0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.624300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e729-3389-42d2-9f2e-f995b1be9302 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.665705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.666551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.666934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.667310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.676330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.677811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d3abb0f6-bdeb-45a6-a020-802bf0d9689b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:28.689536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:28.690937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:28.692010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:28.697920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 262/539] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:28.699361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.699967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.700082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.714122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.720551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:28.723259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:28.748303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf690-5fe7-405f-84ad-1eb716d6a8b0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:28.795007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:28.795755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:28.796136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:28.796505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:28.797379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=e975eec1e5ff4fda97d9a51abd6240bf) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:28.797821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:28.799589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 263/540] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:28.801072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:28.801788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:28.804015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:28.811033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 278/541] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/role_assignments?user.id=e975eec1e5ff4fda97d9a51abd6240bf&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:28.969446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b12f1-35cb-4ec2-b2d0-124a56620f00 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:29.015856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:29.017135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:29.017552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:29.017958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:29.019438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:29.019885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:29.021593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:29.027395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:29.040700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 264/542] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:29.044765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:29.103375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:29.173876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aa9dd-d2e5-4095-a081-baf64f928f88 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:29.234070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e1161-0eb3-4cb3-8bbe-b591129d8519 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:29.237096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:29.238539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:29.238969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:29.239375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:29.240236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=f589a94d7e714f01bdf29794f8e4e5fd) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:29.240683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:29.242396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:29.256999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 279/543] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:29 2022] GET /identity/v3/role_assignments?user.id=f589a94d7e714f01bdf29794f8e4e5fd&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:29.292648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:29.293312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:29.293584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:29.293861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:29.316163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:29.321640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:29.322748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:29.323655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 265/544] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:29.329130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:29.415840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:29.467454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46791ae-1a5f-4c6c-a501-02b31d549c47 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:29.519361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:29.520218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:29.520663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:29.521079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:29.521899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:29.526450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:29.528055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:29.537777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 280/545] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:29.543790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:29.668906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:29.729606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94932-1df9-44cc-ad32-264e54b2332f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:29.779009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:29.779571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:29.779856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:29.780129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:29.792172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:29.793630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:29.812838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:29.813858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:29.814826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:29.814826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:29.814826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:29.814826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 266/546] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:29.823317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:29.970074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45ec01-1b7f-4f35-9925-7dc2f5f9c400 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:30.002462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:30.019553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:30.020171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.020454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.020725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.021478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:30.021786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:30.023179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:30.041327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 281/547] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:30.046948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:30.204199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23dc25-9fdb-4260-be07-5f6baf029983 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:30.214599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:30.260323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:30.260960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.261240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.261513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.269982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:30.271461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-927fadfb-f30c-40b5-98a9-dffe1392cfe6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:30.291757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:30.293150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:30.294195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 267/548] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:30.298568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:30.389028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff75-d11b-433e-9092-4cbe3506cd70 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.389318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff75-d11b-433e-9092-4cbe3506cd70 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.389601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff75-d11b-433e-9092-4cbe3506cd70 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.390968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 268/549] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:30.396595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.396882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.397159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.438458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:30.441359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:30.443560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ee854-ff4e-41cb-8ea0-31cf3762b2e4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:30.519863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:30.520721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.521372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.522478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.523351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:30.524901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:30.526499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:30.553769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 269/550] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:30.559746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 282/551] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:11:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:30.570678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:30.678036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:30.681952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e31c3-ff22-4ca2-826f-5dc8d5332f3f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:30.717738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:30.718376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:30.718655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:30.718925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:30.795885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:30.797360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:30.931421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:30.936438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 270/552] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:30.942537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:30.944760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.029303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.069954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00775f02-cd53-4cea-82ac-56d26477c494 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.102662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041913c7-a23c-4220-ab4f-f89db65e5fde None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.114927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.115580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.115869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.116148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.130553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-cf82d5ee-7589-4b8e-8e63-cb0f12346dea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:31.135365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:31.136237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:31.137020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 271/553] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:31.137704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b37fb-c7a1-47a2-ae02-c2d6dc7160e9 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.138288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b37fb-c7a1-47a2-ae02-c2d6dc7160e9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.138288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b37fb-c7a1-47a2-ae02-c2d6dc7160e9 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.142259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 272/554] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:31.147066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b37fb-c7a1-47a2-ae02-c2d6dc7160e9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.155320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.155957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.156237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.156502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.171226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.173537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-13e0a90f-05e7-47f9-a01a-dcc490e664c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:31.195346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:31.196405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:31.197247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:31.197247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:31.197247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:31.203886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 283/555] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:31.203886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.204091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.204588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.225142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.226168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:31.227579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:31.287528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b37fb-c7a1-47a2-ae02-c2d6dc7160e9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.314244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 284/556] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:31.314244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.335775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.346149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.347797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.348294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.348792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.349664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:31.350198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.358298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99943ca-80ca-4db0-8a28-179ad71a4fb7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.368094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 273/557] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:31.375592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2b36-4a8b-411c-b5b6-dd98eefb0f43 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.376140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2b36-4a8b-411c-b5b6-dd98eefb0f43 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.376644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc2b36-4a8b-411c-b5b6-dd98eefb0f43 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.378125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 274/558] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:31.379058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2b36-4a8b-411c-b5b6-dd98eefb0f43 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.423453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711fbb-0a26-433b-913d-7dedb836bc29 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.467697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.468634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.469098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.469514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.470403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:31.470839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.473945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30d534-aa48-4e57-9a3a-2e1a09ef8fdb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.492220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 285/559] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:31.494259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.494687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.495100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.514460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:31.516330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:31.520241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc2b36-4a8b-411c-b5b6-dd98eefb0f43 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.548419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.567516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.568260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.568609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.568947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.582624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.584518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.602294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 286/560] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:31.603365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:31.603472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:31.604319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:31.605201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:31.605201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:31.605201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:31.605201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 275/561] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:31.615156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.651310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.753274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c892ef-8964-40e0-82a7-006a3c38f43e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.760712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5386432-f6aa-4c28-9182-18a084042d5c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.804217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.804753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.805387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.805666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.805939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.806150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.806818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.807364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.808473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:31.809382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.811010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.818585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:31.820039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:31.829804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 276/562] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:31.832018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:31.837250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:31.838119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:31.839001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:31.843220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 287/563] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:31.844068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:31.877621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.925681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:31.953461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d06b1-76d1-40e2-9427-5310f56063e2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.953839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d802a6-1b3c-4705-976e-2618ff20e021 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:31.990523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.990883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:31.991185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.991466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:31.991587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.991737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:31.991827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:31.992004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.000957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.002457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.004823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:32.009807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.010894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:32.011710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:32.016118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 277/564] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.016900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:32.019352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.020252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 288/565] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.026227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.137615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.138155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cf9b3-ff88-4fcb-b0c2-792188700c92 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.147023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf160acd-ca2d-407b-9c27-6430bdaaf3b5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.172087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.172705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.172980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.173249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.175886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.182031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.182666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.182943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.183213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.183891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:32.184198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.185025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:32.185640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:32.190749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.191642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:32.192455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 289/566] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.193118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.198555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 278/567] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:32.199358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.294085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0f540-9155-491a-87f4-0037da0837c1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.296526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c92e11-5c82-4693-95e4-759b13c90135 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.328050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.328658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.328931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.329204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.329863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:32.330169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.330715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.331338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.331595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58c2d-0001-415b-9ade-44a273c810ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.331696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.331884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.332601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:32.332911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.334371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.340392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 290/568] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:32.341582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6999-d4ad-4fd5-953c-bd8c6471e55f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.342046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6999-d4ad-4fd5-953c-bd8c6471e55f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.342355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6999-d4ad-4fd5-953c-bd8c6471e55f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.343854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 291/569] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:32.344553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6999-d4ad-4fd5-953c-bd8c6471e55f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.355904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 279/570] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:32.356732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.368680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.406348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.453294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6999-d4ad-4fd5-953c-bd8c6471e55f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.453742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbec21-0608-4336-b64d-60a116d1bb6f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.488367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.488964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.489239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.489329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.489507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.489907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.490166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:32.490279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.490469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.490570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.491185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=a90385a931614a58ac3782a79b1a9457) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:32.491493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.491863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69066352-5dfc-42be-897c-ad6ce1757278 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.492916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.498129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 280/571] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/role_assignments?user.id=a90385a931614a58ac3782a79b1a9457&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:32.498929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.505599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 292/572] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:32.505599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.505599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.505599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.527829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:32.529511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:32.587211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.613851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 293/573] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:32.615165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.629178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d094d-80d4-42a7-9f4f-61e6548ded8d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.671912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace842b-1113-49da-9930-90e258248341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.673003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace842b-1113-49da-9930-90e258248341 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.673282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace842b-1113-49da-9930-90e258248341 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.673554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace842b-1113-49da-9930-90e258248341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.686417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.694271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace842b-1113-49da-9930-90e258248341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.694271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace842b-1113-49da-9930-90e258248341 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-cace842b-1113-49da-9930-90e258248341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:32.705758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.707092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:32.707937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:32.707937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.707937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:32.708659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 281/574] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.710752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace842b-1113-49da-9930-90e258248341 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.772100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddd607-33e3-4c3e-9cd6-fd1f3e0bb1c6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.820145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.820857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.821259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.821629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.823493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace842b-1113-49da-9930-90e258248341 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.838521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.840103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.855473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:32.856283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.858030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:32.859194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:32.859194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.859194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:32.864805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 294/575] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.864805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.874098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:32.875282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:32.875708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:32.876505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:32.890068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:32.892213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:32.910498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:32.911674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:32.912760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:32.912760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:32.912760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:32.912760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 282/576] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:32.912760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:32.975956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4c5ea-993d-4ead-8b34-04cd78eec58d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:32.977671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.011538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.012158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.012433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.012706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.013356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.013692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.015072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.023530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbffa83-7350-4543-8699-10699dca2e71 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.031478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 295/577] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.031478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.061170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.061784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.062066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.062364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.063000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.063304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.064671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.082396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 283/578] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.082396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.125904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.150729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915eefc-847d-44bb-8249-0e901d9510ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.188230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.189013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.189292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.189861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.193007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3c71-5303-4875-8208-158985fd8b82 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.201778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:33.207302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:33.208225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 296/579] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:33.210424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.233114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.233726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.234005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.234354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.234960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.235266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.236638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.240741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.253759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 284/580] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.253759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.333464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2e750-cfbf-44b4-a634-bd7198d6ed94 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.351518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.355216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62463e-653f-4135-be63-c4047fc92b71 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.373977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.374722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.374925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.375190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.384058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.385588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.396228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.396866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.397149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.397423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:33.398589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:33.399474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 297/581] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:33.400516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.409873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.411525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:33.423248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:33.424112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:33.425966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 285/582] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:33.428310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.493496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.514748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4154-bf4a-44c3-a9d4-927554ff20a0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.530111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419f093-9e22-4711-a435-233046cb94bc None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.551368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397057-f990-40d0-812a-057ca1465164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.552620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397057-f990-40d0-812a-057ca1465164 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.552905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397057-f990-40d0-812a-057ca1465164 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.553174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397057-f990-40d0-812a-057ca1465164 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.553984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397057-f990-40d0-812a-057ca1465164 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.554313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397057-f990-40d0-812a-057ca1465164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.555674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397057-f990-40d0-812a-057ca1465164 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.564162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 298/583] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.564944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397057-f990-40d0-812a-057ca1465164 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.566918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.567748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.568030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.568302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.576437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.577883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:33.589746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:33.590802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:33.591742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 286/584] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:33.592307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.615587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.684745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397057-f990-40d0-812a-057ca1465164 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.701595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e2453-17cc-46bf-8b1a-d17413e99b70 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.726608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.727221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.727506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.727946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.728510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.728865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.730436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.739338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.739943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.740219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.740493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.741176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.741476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.742922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.748389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.753175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 299/585] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.755390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.757670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 287/586] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.759076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.845877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:33.868607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551946-9b5e-4b94-8702-43b8be0b23b6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.869116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494faaf6-a0d4-4464-b1fb-a7a9a34660de None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:33.904537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.905142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.905419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.905694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.906438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:33.906739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.908161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.912583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:33.913437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:33.913893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:33.914377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:33.926674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 288/587] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:33.927454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:33.932334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:33.933782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:33.953244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:33.954154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:33.955066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:33.955066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:33.955066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:33.955856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 300/588] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:33.956540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.014013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.035960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419f067-5271-48ed-98ef-fac5129fdf34 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.069472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56c781-1daf-41b3-8093-1aebc9546dce None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.071384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.072013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.072287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.072555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.075206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.084370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.085811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:34.102590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:34.103510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:34.104491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:34.104491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:34.104491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:34.104491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 289/589] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:34.105252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.112060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.112760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.113035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.113301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.128703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=9b8e7a5dbd3e42f0930b893394256697, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.130274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.154248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 301/590] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:33 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:34.154248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.231262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67bf8e-40f0-4380-b9d8-913c2a8dd91c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.274486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.275227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.275718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.276115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.288309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506c03a-6807-4999-bfa4-2eff24a61d8f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.289698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.290368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.292670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:34.313669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:34.314715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:34.315993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:34.315993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:34.315993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:34.315993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 290/591] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:34.316967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.333280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.333899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.334483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.334732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.335420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:34.336222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.337892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.355075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 302/592] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:34.357564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.370562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.440704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229b5dc-4667-4b78-8a95-42bcd5696c8e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.477304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.478059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.478482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.478829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.479687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:34.480066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.481552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.490565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3818bf-893f-4a8d-8d09-bff907bb548a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.494603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 291/593] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:34.495422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.537612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.539106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.539566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.540016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.541318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:34.541801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.543711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.558152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 303/594] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:34.564415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.598087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.606701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.610020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f0ca0-e8f6-4e63-b3ab-448b27ee0ff9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.648741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.649536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.650047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.650424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.657825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.659799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:34.671822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:34.672782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:34.673699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:34.678241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 292/595] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:34.679202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.702000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30beee-73f4-495d-b4b1-e7a9fb2eb147 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.740991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.741630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.741912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.742187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.749154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.750695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:34.765319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:34.766534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 304/596] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:34.767397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.793842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adf724-aa8d-4e8a-83a0-0b44e1c9b917 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.835170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.835809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.836087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.836360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.843880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.845309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d497feb9-3454-4403-98d7-f265fdb749aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:34.857729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:34.858651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:34.859967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:34.860709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.860785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 293/597] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:34.860785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059598-286a-4624-9e0b-35e745bcdd06 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.860785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059598-286a-4624-9e0b-35e745bcdd06 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.861112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059598-286a-4624-9e0b-35e745bcdd06 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.862861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 294/598] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:34.863694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059598-286a-4624-9e0b-35e745bcdd06 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.886116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53afba5-6573-4666-846b-b6b267db37df None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:34.892068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:34.921839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:34.922560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:34.922754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:34.923027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:34.923766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:34.924068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:34.925812 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:34.944616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 305/599] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:34.945698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:34.989218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059598-286a-4624-9e0b-35e745bcdd06 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.026629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.027238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.027513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.027783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.028467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:35.028770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.030288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d04769-cc91-4a90-aaaa-f6ca6f7323bf None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.047627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 295/600] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:35.047627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.047627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.047627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.062891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf2c7a-fd52-41c0-b261-17d186009ab5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.064661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:35.066762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:35.102005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.102695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.102972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.103242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.103957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:35.104422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.106696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.117739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:35.126171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 306/601] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:35.126913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.146388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 296/602] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:35.146388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.156801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:35.249057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54bf7-ac28-4fad-ae87-abecb7247026 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.275605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587fa8e-901b-4c5c-9e3d-cacfc6b1a9dc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.286664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.287534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.287534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.287813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.300056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.301516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:35.317917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:35.319096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:35.320120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:35.320120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:35.320120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:35.323675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 307/603] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:35.323795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.324524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.324753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.325171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.325575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/55004b070d1e42968d2f8272071034bb/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.346114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=55004b070d1e42968d2f8272071034bb, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.349355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.372545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 297/604] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:35 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/55004b070d1e42968d2f8272071034bb/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:35.372545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.398340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:35.477997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a5d2-8ccd-47d3-b768-19ebaeaeaced None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.479266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:35.525491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.526237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.526519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.526840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/e975eec1e5ff4fda97d9a51abd6240bf/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.566328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb61f-4d35-4b1c-a4cc-91f510b8c471 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.566518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=e975eec1e5ff4fda97d9a51abd6240bf, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.567530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.612839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 308/605] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:35 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/e975eec1e5ff4fda97d9a51abd6240bf/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:35.613687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.631855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.632754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.633393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.633742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.634915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:35.635293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:35.637438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:35.656365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 298/606] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:35.663613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.789344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0e8d4-6c08-4f88-97b8-e8ef21155d8b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:35.800807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:35.868452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:35.869577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:35.870051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:35.870730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:35.901083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:35.907056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:35.908026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:35.908935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:35.912079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 309/607] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:35.918725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:35.974165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65db731-fbe1-431f-be07-8edf8ba1673b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.013519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:36.083640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565708b-43fd-486c-b149-a41775932096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.084217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565708b-43fd-486c-b149-a41775932096 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.084497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565708b-43fd-486c-b149-a41775932096 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.084765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565708b-43fd-486c-b149-a41775932096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.088929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f12b8-0c75-4b27-91f8-cb9d4cb3f0ff None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.111087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565708b-43fd-486c-b149-a41775932096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.113174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565708b-43fd-486c-b149-a41775932096 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-3565708b-43fd-486c-b149-a41775932096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:36.138768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:36.139684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:36.140617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:36.141028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.141028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.141028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.141028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.141809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:36.141809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.144927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.147103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 299/608] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:36.152730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565708b-43fd-486c-b149-a41775932096 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:36.180143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 310/609] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:36.191247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:36.272316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:36.293668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565708b-43fd-486c-b149-a41775932096 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.332636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.333253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.333531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.333854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.334523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:36.334895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.337854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.350206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 300/610] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:36.358167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:36.442596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:36.447854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1be98e-f016-4442-ab6a-5e02ffd4c7f6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.527536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.528182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.528458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.528734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.552555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6387-5e73-411a-b89a-d5f19bb3a93f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.555336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.556802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.588847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.589432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.589720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.589999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/f589a94d7e714f01bdf29794f8e4e5fd/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d991b564-e83c-41cb-b2f8-971239cf815a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:36.591817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:36.592717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:36.593577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:36.593577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:36.593577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:36.593577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 311/611] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:36.607625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c980-8032-4ecc-9bfa-a3d5b23f1b3e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.607969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c980-8032-4ecc-9bfa-a3d5b23f1b3e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.608245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c980-8032-4ecc-9bfa-a3d5b23f1b3e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.609724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 312/612] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:36.610542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c980-8032-4ecc-9bfa-a3d5b23f1b3e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:36.611000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=f589a94d7e714f01bdf29794f8e4e5fd, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.613152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328ee99-ef4a-4039-8604-86f33ee67498 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.630481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 301/613] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:36 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/f589a94d7e714f01bdf29794f8e4e5fd/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:36.638872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.638872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.638872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.681417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:36.682665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:36.745769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:36.798650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c980-8032-4ecc-9bfa-a3d5b23f1b3e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:36.850537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 302/614] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:36.863455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:36.864121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:36.864405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:36.864674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:36.865382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:36.865690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:36.867069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:36.881122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 313/615] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:36.885766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:36.909206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:36.993097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34a80a-afd1-42bd-b1ae-bf0b61dca49d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.028677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.029308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.029586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.029857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.037363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.038844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:37.051562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:37.052552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:37.053534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:37.057360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 303/616] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:37.058738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.162425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9085ff-8be1-4482-b84c-911935f42818 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.198427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.199104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.199384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.199660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.200395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:37.200701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.202134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.204989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:37.225904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 314/617] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:37.227496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.319312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:37.323322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.356358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d8ff-ea5b-4e3f-bbfa-cd89030c3b31 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.437120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845492d8-c06c-4e1a-b479-207d50a48d72 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.474208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.475006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.475293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.475564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.485972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:37.492098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:37.493045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:37.493867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 315/618] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:37.500803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.502965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.503773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.504054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.504323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.550073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.550073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.570599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:37.591633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:37.593004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:37.594099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:37.594099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:37.594099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:37.594099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 304/619] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:37.599308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.635809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5654-0522-4823-bebe-bd6271b8bc69 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.708173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.708703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.708977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.709290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.709962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:37.710357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.711641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.732233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 316/620] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:37.738632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.792934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1864d-8ba2-4124-8502-b867211b3ed8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.856583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:37.865761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.866414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.866696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.866970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.867627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:37.867932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.869345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.900742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 305/621] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:37.909500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:37.928660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855e58e-8883-4590-b01d-145fc1abd68f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:37.944960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:37.963678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:37.964230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.964509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.964823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:37.976935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:37.978507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7aaf1cbc-8bd6-4449-a27b-0aee8107c310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:37.993991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:37.994981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:37.995849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:37.995849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:37.995849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:37.995849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 317/622] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:37.996625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d2e2-1e3c-4239-8f1a-310582c8decf None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:37.996955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d2e2-1e3c-4239-8f1a-310582c8decf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:37.997228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38d2e2-1e3c-4239-8f1a-310582c8decf None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.002247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 318/623] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:38.002247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d2e2-1e3c-4239-8f1a-310582c8decf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.034453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f48ed-6091-4115-82df-9c377e2270a2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.073807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.074849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.075336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.075914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.083882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.085705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-5d6f2548-3f3b-46e3-b235-5934f7cc09b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:38.098789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:38.099713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:38.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:38.106619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 306/624] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:38.108046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.108551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.109145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.109492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38d2e2-1e3c-4239-8f1a-310582c8decf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.130101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:38.131915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:38.148350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.149037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.149312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.149733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.150452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:38.150828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.152409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.168357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 319/625] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:38.169339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.195968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.203380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.224503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 307/626] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:38.225881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.294246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4afa2-c03e-41cd-86af-7515c7767b12 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.329645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.331756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.332260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.332747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.333644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:38.334719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.336773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610f4cf-77a3-4d97-a3af-b18caf8f9b09 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.349473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c7c30-a49e-4345-8684-f8d9818f26a4 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.350366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 320/627] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:38.351699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093582-dca5-4c6a-bfef-9116755e96c8 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.351990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093582-dca5-4c6a-bfef-9116755e96c8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.352283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39093582-dca5-4c6a-bfef-9116755e96c8 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.354987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 321/628] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:38.355698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093582-dca5-4c6a-bfef-9116755e96c8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.395084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.395742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.396022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.396291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.405178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.407157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-b5f5eead-cf1b-4d57-be50-118701793281 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:38.423475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:38.424439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:38.426056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:38.430119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 308/629] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:38.431829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.432114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.432391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.453636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:38.454612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:38.465808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.481022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39093582-dca5-4c6a-bfef-9116755e96c8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.495190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.522504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.523321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.523919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.524199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/a90385a931614a58ac3782a79b1a9457/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.530568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 309/630] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:38.533152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.542457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=a90385a931614a58ac3782a79b1a9457, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.544583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.563100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 322/631] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:38 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/a90385a931614a58ac3782a79b1a9457/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:38.563914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.721965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ca16d-1609-4373-98fd-15f5956aca17 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.771053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec8f3-6922-4628-8354-e5da93be6db4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.800313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.800929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.801207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.801476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.802233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:38.802534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:38.803962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:38.834382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 310/632] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:38.834382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.838522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:38.839267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:38.839624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:38.839990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:38.848146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.852496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:38.857697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:38.858639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:38.859465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:38.860572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 323/633] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:38.865970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:38.886603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:38.962479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb990bd-26c8-4238-bd63-aec74535050e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:38.987673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145ec9a-720e-492f-9dde-cff711395bd3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.012561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.013681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.014137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.014997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.026181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.026746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.027135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.027291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.030436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:39.037423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:39.038571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:39.039579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:39.042755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 311/634] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:39.044352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.102519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.106612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.109002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.145406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.157004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aae6b5-daf9-479d-b8ad-6f08811b5a86 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.204229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.205018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.205400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.205852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.206768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:39.207178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.208691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.217947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 312/635] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:39.219311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.241569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 324/636] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:39.241569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.337496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb3547-4186-423f-b27b-8a434b7a8df4 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.358058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.363323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b2ee-67dc-4edc-8924-84c8ed4dfd78 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.374869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.375485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.375761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.376124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.376692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:39.377000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.379460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.391969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 313/637] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:39.391969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.405226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.405944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.406325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.406664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.408185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.417611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.419102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-035e4dd9-2960-4b94-8260-618917e250db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:39.434051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:39.435251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:39.436145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:39.436145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.436145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:39.436145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 325/638] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:39.436661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ccf4b-8065-4860-a11f-a35e4da2cf64 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.436941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ccf4b-8065-4860-a11f-a35e4da2cf64 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.437212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ccf4b-8065-4860-a11f-a35e4da2cf64 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.438745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 326/639] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:39.439481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ccf4b-8065-4860-a11f-a35e4da2cf64 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.512191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1f7bd-b88c-4002-a027-2595c07204c6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.545600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.546193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.546510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.546800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.556444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ccf4b-8065-4860-a11f-a35e4da2cf64 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.559607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.561222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:39.577717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:39.578774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:39.584578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:39.584578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.584578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:39.584578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 314/640] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:39.584578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.600857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.601492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.601837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.602178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.613898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.615359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-48de081e-0ddd-41a6-8bd3-45b1b04630b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:39.630470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:39.631663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:39.632702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:39.632702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:39.632702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:39.632702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 327/641] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:39.635568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.636220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.636513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.645755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.654266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.661478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:39.662736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:39.691649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec68a6-d3b4-43e6-b27c-c07bfe03f921 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.726936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.727542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.727822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.728089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.728719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:39.729035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.730452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.742560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 328/642] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:39.743283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 315/643] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:39.743972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.744105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.863324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1c17-5ae0-4510-972f-38541bc7a64b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.879731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba71c1-bc21-4110-a818-0f1638f36ed9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:39.889555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.900060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.900666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.900947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.901221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.901857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:39.902179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.903569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.916114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 316/644] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:39.916598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:39.916776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:39.923660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:39.925237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:39.925972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:39.926696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:39.927553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:39.928052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:39.930180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:39.944350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 329/645] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:39.945405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.030357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88100868-4397-4aa3-918d-f3040d3aa535 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.063748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5dd4-4565-47e6-9c64-fe1c387a39f4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.067274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.067894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.068168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.068435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.075855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.077276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:40.088030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:40.088932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 317/646] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:40.090016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.105810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.106462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.106738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.107002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.115347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.116708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:40.128503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:40.129448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 330/647] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:40.130423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.150025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.184112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.209182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ed1b-9e4e-4788-a5b1-b253b8bd7d87 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.234200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa1827-0bb9-4ac7-be24-3e3ff95c31d0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.245226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.245866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.246149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.246537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.253875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.255369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:40.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:40.267622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:40.269031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 318/648] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:40.269980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.275575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.276279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.276566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.276840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.288431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:40.293581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:40.294516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:40.295344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 331/649] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:40.296027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.377473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc8c28-6caf-4c55-a32a-2d670a66b429 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.384467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.405884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6aae59-6b9e-432d-8555-2596b5e9977d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.413228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.413831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.414111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.414410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.415130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:40.415433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.416859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.421776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.435690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 319/650] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:40.436831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.450066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.450805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.451047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.451326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.452064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:40.452372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.453782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.477450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 332/651] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:40.477450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.545172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a9b0-6f11-49a8-9727-3494891f14ea None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.579735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.580432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.580884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.581227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.581982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:40.582381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.583322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9c9c-29c8-4c25-b9e3-18b820bb61be None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.583938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.595790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 320/652] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:40.599257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.621534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.622135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.622435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.622704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.623359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:40.623654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.625000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.628623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.633665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 333/653] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:40.634386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.671909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.709115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24f1f7-e764-4350-acd9-cef5bb9daba8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.749336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.749763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98a609-f529-496b-a44a-67a3cfbbf185 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:40.749964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.750275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.750550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.793292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:40.794070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:40.794476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:40.794852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:40.833619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.835237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.861773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.872894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:40.874392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:40.905298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:40.936193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 321/654] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:40.937033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:40.976506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 334/655] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:40.977337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.035318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573aa78-40f3-4b63-b6b2-8b2d1bbe7bcc None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.060644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.073199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.073806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.074087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.074391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.075110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:41.075421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.076330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074d7fd-a607-4168-8839-250e859c54ea None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.076855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcec74-ec1c-4730-add2-9a31d0907468 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.083328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 322/656] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:41.084482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b4c9-1cb6-440c-ae0a-84c1286bb2f5 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.084762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b4c9-1cb6-440c-ae0a-84c1286bb2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.085036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6b4c9-1cb6-440c-ae0a-84c1286bb2f5 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.088661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 323/657] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:41.091133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6b4c9-1cb6-440c-ae0a-84c1286bb2f5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.124391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.131979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.132642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.132933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.133207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.147441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.148925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:41.167570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.168698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:41.169746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:41.169746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.169746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:41.173479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 335/658] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.174530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.216525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6b4c9-1cb6-440c-ae0a-84c1286bb2f5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.255848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.256661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.257042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.258055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.271471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.272947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e50fd993-a56f-4f6e-834f-a397319492f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:41.289545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.290812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 324/659] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.291975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.292368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.297763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da628d-fa23-4dfb-9d79-5c2b52f54bca None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.311733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:41.312934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:41.335206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.335955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.336305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.336655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.349198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.350843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.353597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:41.365655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.366850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:41.367944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:41.367944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:41.367944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:41.369306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 336/660] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.370236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.390751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 325/661] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:41.398401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.423602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.495285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d2a6b-ae47-4e46-b400-2a874c6a150f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.513417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d926d2-a14f-4905-903c-df6440dfeccc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.540870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.541632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.542243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.542567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.543495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:41.543802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.545644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.551530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.552261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.552637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.553506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.554330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:41.554738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.556685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.560097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 337/662] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:41.561065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.577314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 326/663] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:41.578303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.619749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.683149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.690744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d53b55-cd65-4d21-9e9e-fcce76774b36 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.710644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76698f3b-780a-4219-90ed-18b5b5c7afd0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.725616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.726269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.726553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.726838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.727474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:41.727778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.729141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.741375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 338/664] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:41.742189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.749742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.750523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.750812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.751085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.760099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.761555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:41.773316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.774257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 327/665] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.775176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.856209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca54b3-a372-4c8c-a0c6-809987ceaec9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.872320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.884820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40bca2-0ccc-4a93-8636-5c87078c73f5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:41.894757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.895394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.895675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.895953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.902826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:41.904272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:41.916104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.917122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:41.917993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 339/666] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.919268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:41.927960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:41.928273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:41.928552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:41.928826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:41.937289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:41.939928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:41.945960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:41.946955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:41.947781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 328/667] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:41.949203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.032580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f689-615f-4bac-a3eb-2b28e67bb548 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.056109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b796-e0e8-4ce4-ad53-0a4d8d7a8de6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.071775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.072219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.072498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.072771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.079734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.081415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.092419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:42.092809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:42.093652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:42.099928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:42.100342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.100342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.100342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.100528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 340/668] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:42.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.100594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.100711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.100785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.119080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 329/669] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Sep 9 13:11:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.124147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.134422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.183342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.207469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1acdbd-a7ad-4e2d-a002-75c2827ea681 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.233906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bfad5-593c-41d5-aac3-e49e2822a31b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.241911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.242545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.242821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.243087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.243773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.244075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.245505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.257391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 341/670] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.258181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.275929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.276808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.277367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.277790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.278709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.279173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.280797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.290202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 330/671] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.291155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.364654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.367487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee5af-4f56-47d3-b327-f2d92ccbf2a3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.396537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b550bd9-5b0e-4350-953f-d43385365d48 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.404789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.405401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.405680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.405946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.406684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.406995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.408433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.412017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.428279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 342/672] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.429145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.438482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.439402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.440332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.440811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.519513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.521527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.530494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8493-6be9-49ff-84b1-278a6fc41d02 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.569685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.570738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.571329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.571605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.572483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=55004b070d1e42968d2f8272071034bb) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.572794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.574532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.590261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 343/673] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/role_assignments?user.id=55004b070d1e42968d2f8272071034bb&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.590261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.603722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.656626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 331/674] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:42.657597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.670027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.717956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e577a-2dd1-4cd3-b841-a7eebcb22d87 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.756315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.757168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.757513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.757851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.773817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.776027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:42.795011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:42.796041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:42.797102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:42.797102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:42.797102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:42.797102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 344/675] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:42.797102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.803523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ea238-aaa7-42cd-874b-2964cd1b1870 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.845161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.847882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.848188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.848436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.849165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=e975eec1e5ff4fda97d9a51abd6240bf) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:42.849486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.850957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:42.857736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 332/676] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/role_assignments?user.id=e975eec1e5ff4fda97d9a51abd6240bf&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:42.858405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:42.900951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.926841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb37e15-c55f-48e9-a573-92fd0449c82d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.946052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:42.978396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:42.979392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:42.979853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:42.980052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80217-1fe4-4770-9283-962fa08b839b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:42.980595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:42.996212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:42.998035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:43.017552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:43.019155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:43.020008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:43.020008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:43.020008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:43.022037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 345/677] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:43.028029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.028802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.029526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.029810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.030083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.030820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:43.031119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.032649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.054862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 333/678] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:43.060148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.197551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd9d5-a376-4db0-b94a-b0bec71c3680 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.209390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:43.219114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17e7c-c003-47a5-9130-7373f787173d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.249942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.251039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.251318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.251588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.252242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:43.252564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.254124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.269815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.270495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.270770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.271036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.272649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 346/679] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:43.277599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.279170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.280550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:43.299055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:43.300435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:43.301378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 334/680] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:43.307296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.317667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:43.427696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86640-d715-42a3-81d4-4253eb1588ab None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.459944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaf9b0-b4d5-492b-82e7-cf63348f5cd0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.467043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.467682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.467953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.468220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.475864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.477284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f4bcfad5-ee1a-45c6-8357-fae5c3ff0aec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:43.488697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:43.489718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:43.490627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 347/681] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:43.491121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b4226-3884-4b7e-ae5c-1f995ab5c03c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.491646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b4226-3884-4b7e-ae5c-1f995ab5c03c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.491646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b4226-3884-4b7e-ae5c-1f995ab5c03c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.493039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 348/682] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:43.496401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b4226-3884-4b7e-ae5c-1f995ab5c03c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.510284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.511188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.511464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.511730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.512715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:43.513486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.515209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8025b-4458-4828-984d-7ef51077db13 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.542449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 335/683] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:43.543631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.543910 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.544187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.566987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:43.568290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:43.576163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:43.601653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:43.620492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b4226-3884-4b7e-ae5c-1f995ab5c03c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.669271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 336/684] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:43.669271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.675465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.676211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.676591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.676966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.677775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:43.678189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.679734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.706622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 349/685] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:43.712989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.810941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632084eb-d36a-48d4-bbbd-eb735caf828f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.848527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03066f-1ad5-49bf-9af0-7e3f66140b32 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:43.876991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.879732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.880123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.880499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.918559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:43.925410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:43.926080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:43.926492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:43.926865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:43.927697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=f589a94d7e714f01bdf29794f8e4e5fd) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:43.928111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.931116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.945309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 350/686] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/role_assignments?user.id=f589a94d7e714f01bdf29794f8e4e5fd&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:43.979057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:43.989732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:43.991444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:43.992303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.108286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5c94f-6634-4398-bd07-4fc2abe0c8f9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.120049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 337/687] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:44.121610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.171107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.172055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.173279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.173874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.201124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:44.210142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:44.211360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:44.212404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:44.214762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.224047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 351/688] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:44.228585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.314459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe1a22-6c91-4f6e-b9b7-45d5931143b5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.321362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.366029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.366926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.367338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.368061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.369918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f39ae-a7a8-469e-9c6d-9e3a202133df None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.382092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:44.384516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:44.407013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:44.408249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:44.409821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:44.409821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:44.409821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:44.412954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 338/689] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:44.419842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.426491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.427222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.428721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.429098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.429890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:44.434588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:44.436046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:44.452634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 352/690] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:44.458420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.586514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab27fe9-5b71-4823-9ae1-6f1f7ff3ecb1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.618135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.628062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.628718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.628998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.629263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.637783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.648398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:44.649849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:44.654067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca0ce-ea1a-473c-92d2-6f23e4a2721a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:44.666470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:44.667445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:44.668406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:44.668406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:44.668406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:44.668783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 353/691] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:44.674278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.759504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.760126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.760416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.760692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.761347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:44.761653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:44.766253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:44.784418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 339/692] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:44.795197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.801086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18157802-f32b-499e-bd4a-c3335817bbd1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:44.845908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:44.846597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:44.846880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:44.847155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:44.847808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:44.848117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:44.849489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:44.868103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 354/693] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:44.870087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:44.933189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:44.995731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0c139-2b8f-42a9-bc5e-ec716340c0ae None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.033660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.035164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.035522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.035899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.044592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.046078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.059882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349f596-c899-4fdd-a43a-bbd779f96756 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:45.067865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:45.068800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:45.069741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:45.078321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 355/694] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:45.079873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.126376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.126941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.127223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.128349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.137225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.138725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:45.153635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:45.154616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:45.155521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:45.161161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 340/695] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:45.162533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.194565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.242976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c4a3a-121c-4d79-9485-f2e2d0ff2a09 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.242976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.282246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.282246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.282246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.282246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.282704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:45.282704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.283676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.306536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 356/696] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:45.316010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.351795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa22cb-cc4b-4570-bd9d-4ec152a7af38 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.387869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.388801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.389303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.389780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.390764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:45.391276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.392987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.410491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 341/697] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:45.413270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.440142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215fbde-1279-45d6-b80b-b5635735854e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.479168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.479792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.480070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.480341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.511424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.521701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.554736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ca69b-b216-4f05-9c94-7c78552a21f1 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.558196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.560052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.592723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.593683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.594169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.594695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.595621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=a90385a931614a58ac3782a79b1a9457) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:45.596136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.598524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e585d-dc64-4d73-bb52-587f34814b8f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.606484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 342/698] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/role_assignments?user.id=a90385a931614a58ac3782a79b1a9457&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:45.608343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9531-a0f9-45fc-8350-82200967fcf0 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.608894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9531-a0f9-45fc-8350-82200967fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.609420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9531-a0f9-45fc-8350-82200967fcf0 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.611014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 343/699] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:45.616925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4802f-0e21-4c72-8900-229fcf72411a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.617635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4802f-0e21-4c72-8900-229fcf72411a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.618146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4802f-0e21-4c72-8900-229fcf72411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.654989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-60e4802f-0e21-4c72-8900-229fcf72411a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:45.657230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-60e4802f-0e21-4c72-8900-229fcf72411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:45.691321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 357/700] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:45.693041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.762626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.796717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 344/701] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:45.798232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f14-0621-4fae-be82-5beba2e09b00 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.807035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f14-0621-4fae-be82-5beba2e09b00 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.807540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2f14-0621-4fae-be82-5beba2e09b00 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.809430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 345/702] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:45.817362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.817790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.818166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.819985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd481-8ac0-4fc8-bec9-8e2f8d5ba992 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:45.852894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:45.858401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:45.869795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:45.870547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:45.870823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:45.871093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:45.882616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:45.884893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:45.903124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:45.904175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:45.905096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:45.905096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:45.905096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:45.905096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 358/703] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:45.914500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:45.938625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:45.946290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 346/704] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:46.045312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633321d1-b3f0-4635-846d-8b6f10ca5dfe None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.059651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.085994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.086632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.086912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.087186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.087899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:46.088201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.089648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.105218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 359/705] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:46.110243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.130874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.236369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c361c5-baa7-4684-baf5-587c6374b24c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.261180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c846da-b5db-45f9-938b-4ac98a78cf25 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.274850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.275877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.276383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.276886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.286060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.287794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:46.301710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:46.302675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:46.303557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:46.303962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.303962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.303962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.303962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.306475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 347/706] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:46.307503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.315964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.318047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:46.337550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:46.338631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:46.339510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:46.339510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:46.339510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:46.339510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 360/707] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:46.344822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.367295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.394748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.450960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15723dd-b79f-4a01-a969-79ffbfb6f52a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.455304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece7e0d-dd40-4fd2-af51-82202b9c44d0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.504827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.505045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.505446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.505727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.506001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.506598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.506704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.507239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.507706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.508088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.509059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:46.509615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.511614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:46.519929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:46.520986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:46.522532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 348/708] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:46.523325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.534927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 361/709] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:46.536531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.630130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5030e-5c92-4576-8186-de81331d3c06 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.637975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.654811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.656778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099c39b-deee-4678-80e4-c2ada47b75da None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.669792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.670533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.670823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.671102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.671742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:46.672048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.673414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.690920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 349/710] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:46.690920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.698551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.699222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.699514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.699791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.700430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:46.700735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.702099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b332f-a1c2-4057-b132-1b4bbc3d8e8f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.707429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 362/711] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:46.709050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863145b6-9583-419e-a32f-06e4c0fe947c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.709439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863145b6-9583-419e-a32f-06e4c0fe947c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.709828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863145b6-9583-419e-a32f-06e4c0fe947c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.715209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 363/712] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:46.715209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863145b6-9583-419e-a32f-06e4c0fe947c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.800718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e28-db9b-49ec-85ec-3384659611a6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.828494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863145b6-9583-419e-a32f-06e4c0fe947c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:46.842689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.843465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.843749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.844399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.845131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:46.845447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.847608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.859597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 350/713] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:46.859597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:46.874765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:46.875306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.875606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.875895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.876620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:46.878310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e3c37-3f0b-4f1c-8413-5166613f111a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:46.908416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 364/714] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:11:46 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:11:46.910292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:46.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:46.915870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:46.930614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.932757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:46.951721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:46.952993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:47.050241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a12e4-9cf2-4a29-acf1-62b795379302 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:47.091574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 365/715] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:47.107315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:47.108033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:47.108318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:47.108588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:47.109223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:47.109530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:47.111021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:47.125330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 351/716] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:47.373637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:47.485749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b7bfc-7bb7-478d-bfc1-51a6a8d43c04 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:47.521390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:47.522024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:47.522328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:47.522600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] PATH_INFO: `/v3/services/network` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:47.523188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:47.524547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:47.535384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:47.536385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:47.537204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 366/717] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:47 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:47.544563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:47.709002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa52a-24cd-4186-acc9-910dccb4795b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:47.721383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:47.758985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:47.759605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:47.759884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:47.760151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:47.760782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] RBAC: Adding query filter params (name=network) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:47.761077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:47.762490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b23192-8017-4734-82c1-9360019fd510 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:47.767703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 352/718] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:11:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:47.773768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:47.887260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a4012-ffe1-47f2-bb9e-d25db64deead None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:47.942711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:47.943339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:47.943615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:47.943885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:47.944532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] RBAC: Adding query filter params (type=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:47.944839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:47.946206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc339ce-545f-458d-a9e9-e687c60de87f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:47.952588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 367/719] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:11:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:48.386922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34f9a-863c-4a5e-a721-b094ec7fe498 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:48.387305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34f9a-863c-4a5e-a721-b094ec7fe498 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:48.387517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a34f9a-863c-4a5e-a721-b094ec7fe498 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:48.389015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 353/720] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:48.394544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:48.394830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:48.395102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:48.422322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:48.423507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:48.493994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:48.512598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 368/721] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:48.936075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a34f9a-863c-4a5e-a721-b094ec7fe498 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:49.079969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a34f9a-863c-4a5e-a721-b094ec7fe498 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:49.128697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:49.129314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.129592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.129864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.144832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:49.149571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:49.150546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:49.151391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 354/722] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:49.156945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:49.283586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7cea-21ce-4cb8-af12-18addc76b718 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:49.329657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:49.330293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.330568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.331455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.332475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:49.332779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:49.334135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdcd88-61b5-44d3-8791-4c6de7ef2202 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:49.342881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 369/723] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:49.349488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:49.384604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:49.423764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374128c-c75b-4f31-870e-037eea78b4d0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.424076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374128c-c75b-4f31-870e-037eea78b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.424321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374128c-c75b-4f31-870e-037eea78b4d0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.427028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 370/724] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:11:49.431315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.431597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.432201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.454578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adafce-ba7f-4a9b-8359-a258802ffb08 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:49.467659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:49.468883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:49.516378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:49.517510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.517798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.518080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.530375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:49.531812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:49.548840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:49.549916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:49.551177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:49.551177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:49.551177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:49.551177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 355/725] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:49.557341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:49.620493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:49.664479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:49.678226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff765223-366a-4905-ac76-2ee1b59534b9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:49.678672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 371/726] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 13:11:49.713691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:49.714330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.714613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.714890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.715531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:49.715844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:49.717639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89c94a-13e6-4936-9096-66fa4cdc2e25 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:49.730914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 356/727] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:49.736483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:49.751803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cc66-6aee-41b9-87bf-ed41c932eefd None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.752084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cc66-6aee-41b9-87bf-ed41c932eefd None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.752351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cc66-6aee-41b9-87bf-ed41c932eefd None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.758166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 357/728] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:49.761837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.762121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.762444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.787012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:49.788198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:49.862944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 358/729] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:49.900182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61e683-c985-42d4-9403-7bc618d384e8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:49.960208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:49.960788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:49.961061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:49.961327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:49.969564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:49.971038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:49.991456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:49.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:49.993443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 372/730] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:50.003330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.008935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.077856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.093574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.118149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292bb6-4ee9-4a21-a314-8e047a9c1d89 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.139024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e72dbf-b5f7-4d8d-8b1a-780f3a5ff770 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.153609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.154238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.154562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.154833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.155623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:50.155920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.157347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea482c-78f9-4c6f-a8b5-18ff5a2a9f3f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.176403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.177017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 359/731] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:50.177818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.177935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973ec7-730f-4d90-8981-a4b23c477af7 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.178208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973ec7-730f-4d90-8981-a4b23c477af7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.178501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.178933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.182937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f973ec7-730f-4d90-8981-a4b23c477af7 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.188163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 360/732] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:50.188163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f973ec7-730f-4d90-8981-a4b23c477af7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.195793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e31ea494-2e17-4171-9410-a6e90293a6bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:50.201997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:50.203151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:50.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:50.207126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 373/733] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:50.208732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.209281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.209823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.229914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:50.231074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:50.294998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f973ec7-730f-4d90-8981-a4b23c477af7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.305775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 374/734] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:50.306644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.332507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.333208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.333538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.333810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.336851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.354361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.419929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.422350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.427677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff09ddd-b5b7-4307-9c3d-160921f9d976 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.465200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.465893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.466292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.466671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.467391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:50.467757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.469180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.482658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 375/735] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:50.483637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.558139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 361/736] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 13:11:50.559409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.603526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.618381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.624321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994012a-8c2a-4bf7-9dbc-449649646a0e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.661268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.661891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.662465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.662746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.663477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.664755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.673648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2662f4-d581-41be-8e81-a205dbe27c65 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.683646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 376/737] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:11:50 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:11:50.684474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.723692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.724376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.724650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.724917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.736896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.739424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:50.757696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:50.758786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:50.760285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:50.760285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:50.760285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:50.760285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 362/738] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:50.760285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.841611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ead0c-1ef5-4150-944c-d6877fe47c21 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:50.882583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:50.883330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:50.883609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:50.883878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:50.896878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:50.898392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:50.915579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:50.916613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:50.917503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:50.917503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:50.917503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:50.917503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 377/739] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:50.917722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:50.932218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:50.994622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.014299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ccec-ea63-41be-b9d9-c8105da36669 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.031022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74991371-f520-4657-bfd7-31fd5fd53bb5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.051519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.052156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.052455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.052725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.063495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ec54d95f-bf95-4aab-acfa-c3a7550fb9a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:51.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:51.069919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:51.075853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:51.076474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.076474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.076474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.076474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.076767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 363/740] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:51.076844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:51.076844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.076967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1236435-f7bb-4371-a6e0-44f3dca1d2ed None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.076967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1236435-f7bb-4371-a6e0-44f3dca1d2ed None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.077094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f272c-21be-4dd4-891a-8580bd925e73 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.077162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1236435-f7bb-4371-a6e0-44f3dca1d2ed None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.077162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 364/741] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:51.077162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1236435-f7bb-4371-a6e0-44f3dca1d2ed None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.090711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 378/742] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:51.092164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.092572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.092908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.113372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:51.114583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:51.180726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.187732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 379/743] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 13:11:51.188873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.203204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1236435-f7bb-4371-a6e0-44f3dca1d2ed None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.242198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.242856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.243110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.243407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.244023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:51.244322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.245749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.262365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 365/744] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:51.263218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.269273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.307072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3228a-aa60-431e-9c71-994f72275964 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.357359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.358893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.359173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.359447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.360113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:51.360417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.361769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.370031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 380/745] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:51.370855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.409263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4dfd7-9b35-4baf-947b-0594cdaa1977 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.445373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.446180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.446484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.446752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.452508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.457993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.459532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:51.472553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:51.473726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:51.474725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 366/746] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:51.475294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.505781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ef11-a7d4-4490-91b3-923b5306dd48 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.538612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.542285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.542977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.543294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.543517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.551235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.552684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:51.564007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:51.564895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 381/747] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:51.571143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.588815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f2ba-d825-4413-997e-803cf6d4fd37 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.624671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.625297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.625571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.625838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.637029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.638515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:51.653300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:51.654503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:51.655378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:51.655378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:51.655378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:51.655378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 367/748] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:51.655658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.686726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c563e6-aad0-44e8-9841-204275991d20 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.708982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.725870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.726691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.727207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.727717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.728533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.730018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.745600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 382/749] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:11:51 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:11:51.746739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.762076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcefba-d3cd-4d3b-8c94-e7d23662e9f4 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.779798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:51.816697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.817548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.817919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.818513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.819384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:51.819762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.821431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.845961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 368/750] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:51.847644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.887068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d83566-d9c5-4f90-88fe-3435399875ed None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:51.930857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:51.931801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:51.932260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:51.932706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:51.933633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:51.934121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:51.936599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:51.955223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 383/751] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:51.957031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:51.971739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d638e-1200-438c-8b1b-ec9bac471782 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.016387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.021984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.022802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.023203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.023539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.024584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:52.024894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.030412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.039759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 369/752] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:52.040610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.076562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.094569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55192c-5d4c-4d44-93d8-a630d0469fdb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.136619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.137256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.137536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.137809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.148579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.150030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.157810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1e278-31d8-4438-927d-99a4babff75a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:52.168247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:52.169176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:52.170053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:52.170053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:52.170053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:52.170053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 384/753] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:52.170599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.203952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.204883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.205176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.205451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.206737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=a90385a931614a58ac3782a79b1a9457) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:52.207055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.208993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.222251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 370/754] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/role_assignments?user.id=a90385a931614a58ac3782a79b1a9457&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:52.222251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.301986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.312029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183d95-7cfe-4ae4-a41d-4eb6ba506200 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.384041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.387030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.387693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.387972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.388245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.394378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aa17c-8bd5-4e3a-8788-fe4fb0865ba9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.407179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.408652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:52.433243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:52.434273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:52.435265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 385/755] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:52.441475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.473852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.474477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.474758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.475029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.475678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:52.475975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.477346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.505100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 371/756] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:52.515177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.570070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc20c-6355-4995-84b8-5158869920c9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.610154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.611179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.611747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.612900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.614055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:52.614596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.616219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.636548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 386/757] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:52.641598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.655450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.751587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de74-3130-439c-bbd9-f334cdd97b7e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.788912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.789880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.790424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.790933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.833435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbadb2-6c5a-4eb4-8fdc-21e4e1f9a75d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:52.876274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.878814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacba-bd89-4a8b-8d25-624e52c7bba7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.904668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.919850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:52.920498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.920779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.921050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.933276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:52.942887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:52.964717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:52.965654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:52.966550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 372/758] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:52.972003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:52.992738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 387/759] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:11:52.994473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28f31-1e47-4979-91b5-316aeab1007e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:52.994985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28f31-1e47-4979-91b5-316aeab1007e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:52.995454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28f31-1e47-4979-91b5-316aeab1007e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:52.996175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:52.998442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 388/760] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:52.999364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28f31-1e47-4979-91b5-316aeab1007e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.098263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afedbe-3f33-4806-9b1d-1065427ec761 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.110151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28f31-1e47-4979-91b5-316aeab1007e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.135401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.136247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.136690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.137140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.137990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:53.138487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.140225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d9ea9-cad2-4da5-be9d-a5119a9a8f18 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.148357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.149289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.149400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.149685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.150711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:53.155546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 373/761] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:53.157120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.157529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.157979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.167217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.168809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.178229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:53.179668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:53.186223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:53.187340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:53.188409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:53.188409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:53.188409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:53.189879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 389/762] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:53.191760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.267227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 374/763] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:11:53.269330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.282618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:53.309543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79353612-7892-49fa-a963-c05dab22e5ed None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.353427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.354449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.354933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.355409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.359310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=9b8e7a5dbd3e42f0930b893394256697, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.360964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.385033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 390/764] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:53 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:53.436640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85976544-5afd-478e-ae9f-19b93e66fedb None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.477737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.478785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.479271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.479746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.480631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:53.481139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.482828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.497568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 375/765] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:53.503865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.536217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:53.621515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.641156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b978-c295-418a-a901-36fbfaae3c12 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.686830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.687475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.687750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.688014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.696578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.698365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:53.713086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:53.713994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:53.714893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:53.718143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 391/766] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:53.724411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.727862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:53.803398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97a860-2236-4d56-9805-876cfa73789e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:53.866331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:53.868283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:53.868488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:53.868831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:53.869162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:53.869720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:53.872148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:53.887890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:53.888931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:53.889744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 376/767] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Sep 9 13:11:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:53.899340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:53.911523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541661c1-5102-4964-a8bd-419cbd8c88a4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.016260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.016885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.017158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.017431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.018135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:54.019116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.020629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.021557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d818-1586-43f2-86de-65d1c310b1d1 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.049749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 392/768] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:54.055700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:54.058564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:54.066944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.068187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.068803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.069342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.070122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:54.070621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.072221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.077729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 377/769] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:54.085000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:54.263355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a549ca-b2b3-49fa-b573-3465e5c64678 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.287940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930427-443f-4f6b-920a-9767ce964b2a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.334044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.335179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.335465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.335734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.336375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:54.336681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.338048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.344141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 378/770] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:54.350582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:54.380738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.381420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.381632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.381903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.382669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=38bf5893ca6f4ee89cc56bdb1e839f75) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:54.382978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.384407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81f15a-86eb-4d33-bfb9-6add04a90eed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.392626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 393/771] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:11:54 2022] GET /identity/v3/role_assignments?user.id=38bf5893ca6f4ee89cc56bdb1e839f75&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:54.401849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b507-eed9-4ed9-9854-1382e2b5e5f9 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.402164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b507-eed9-4ed9-9854-1382e2b5e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.402429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870b507-eed9-4ed9-9854-1382e2b5e5f9 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.403823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 394/772] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:11:54.416479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.416808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.417017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.438496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:54.454125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:54.456791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:54.460642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:54.535224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbc02c-57cb-4600-a47c-2cda9db3c005 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.599006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.600044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.600534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.601000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.601924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] RBAC: Adding query filter params (interface=public, service_id=c127b130e8ee49ecab5ef865291ff89b, region_id=RegionOne) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:54.602455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.604480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.611327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 395/773] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:11:54.625052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 379/774] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:11:54 2022] GET /identity/v3/endpoints?service_id=c127b130e8ee49ecab5ef865291ff89b&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:11:54.630799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:54.744630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353caf0c-0b08-4d85-aa16-31583a0d7ea0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:54.805918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:54.806492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.806772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.807040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.807693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:54.809167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec07846-fecd-43fe-81e2-64c76523a776 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:54.814639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:54.820944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 396/775] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:11:54 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:54.929192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:54.995356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2cfa8-0582-49ca-acd9-e986c64266c5 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:54.996039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2cfa8-0582-49ca-acd9-e986c64266c5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:54.996522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2cfa8-0582-49ca-acd9-e986c64266c5 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:54.998554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 397/776] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:55.005266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.005868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.006490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.030950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:55.035467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:55.125956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4f88e-917c-45d3-a009-b0bee2604638 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:55.152680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:55.176053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:55.176698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.176976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.177245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] PATH_INFO: `/v3/services/network` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.177758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 398/777] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:11:55.177947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:55.179429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:55.189961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:55.191006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:55.191833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 380/778] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:54 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:55.196932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.328462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04b405-c5d4-4c13-9c29-e2d92b39ff2f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:55.376671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:55.385291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:55.386631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.387075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.387496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.388284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] RBAC: Adding query filter params (name=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:55.388735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:55.390299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:55.398586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 399/779] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:55.404408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.544748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7aefa-9001-4571-afb7-94436257689b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:55.559812 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.585487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:55.586111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.586418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.586688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.587323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:55.587626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:55.589932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:55.602389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 381/780] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:55.609275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.664770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:55.746962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3762-28aa-4395-a63b-5e88cbdf50ed None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:55.757392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7b21-470a-4782-aa9e-aa8c5afc62c6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:55.803003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:55.804014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.804520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.804996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.835090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:55.842032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:55.842946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:55.843452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:55.843940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:55.844845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] RBAC: Adding query filter params (interface=public, service_id=0646154e6322493fad05207bd8b1fd9d, region_id=RegionOne) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:55.845374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:55.847510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:55.849395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:55.850370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:55.851212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:55.859758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 400/781] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:55.864954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 382/782] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/endpoints?service_id=0646154e6322493fad05207bd8b1fd9d&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:55.870901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.876489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:55.984996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:56.023758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa746208-9672-4210-84e1-d1a3f7bd0172 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.042544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:56.072877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c8ca1-de44-40f6-ba4d-e09047941206 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.090594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.091228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.091509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.091782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.092585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:56.092892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:56.094458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eff30-e751-42e5-9e01-b7dc68c54452 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:56.115384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.115384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.115384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.115719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 383/783] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:56.115818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.115818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:56.118111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22da2d-1ef2-45ef-9eb2-4b8501dd6145 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.118111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22da2d-1ef2-45ef-9eb2-4b8501dd6145 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.118111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22da2d-1ef2-45ef-9eb2-4b8501dd6145 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.118327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c8aad-549e-40a5-9d1f-b9b0d32b14cd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:56.118408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 384/784] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:56.125305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 401/785] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:11:55 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:56.126699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22da2d-1ef2-45ef-9eb2-4b8501dd6145 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:56.127888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.128177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.128453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.150418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:56.151662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:56.238585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 402/786] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:11:56.332151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22da2d-1ef2-45ef-9eb2-4b8501dd6145 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.369388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.370486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.370991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.371495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.384336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:56.386255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:56.402783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:56.403725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:56.405074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:56.405074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:56.405074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:56.407988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 385/787] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:56.419317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:56.483674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:56.542923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ff14f-492a-4aa4-a2d3-460ab0485059 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.578513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.579125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.579401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.579670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.580321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:56.580622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:56.583376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:56.584489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:56.603706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 403/788] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:56.618277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:56.637591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:56.779495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a7ba-a40f-443c-a5ff-3ebc445f3257 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.797441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760abc1-1c62-49f3-b83b-0c856401f2e7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:56.810239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:56.851660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.853075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.853744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.853893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:56.854474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.854589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:56.854798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:56.855071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:56.863962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:56.865902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:56.874353 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:56.883066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:56.884163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:11:56.885125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:56.891298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:56.892431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:11:56.893816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:56.897155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 386/789] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:56.897512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 404/790] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:56.902845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:56.905753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.009579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.030753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f033-5ddd-4ae7-bb3c-ba9d7b0b3628 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.097499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.098043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.098386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.098668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.099897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:57.100215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.101814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.122291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 387/791] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:57.125306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eab163-6d38-4ace-8d81-cb2981697bcc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.128302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.227888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.228842 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.229314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.229761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.230645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:57.231133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.232677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.253606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 405/792] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:57.259604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.280368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187715-7723-47a2-b73e-61bc3f53430f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.300299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.320692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.321410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.321693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.322008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.334408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.335970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4c222d2a-f730-4322-b617-8de335d9cf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:57.352861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:57.353789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:57.354727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:57.354727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:57.354727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:57.354727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.358586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 388/793] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:57.360068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18a5b-966e-4390-8be5-32752756a6ce None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.360352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18a5b-966e-4390-8be5-32752756a6ce None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.360629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18a5b-966e-4390-8be5-32752756a6ce None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.366703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 389/794] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:57.367503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18a5b-966e-4390-8be5-32752756a6ce None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.391776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-e093-4078-a927-22d1796b80df None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.439248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.441013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.441537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.442020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.456251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.458304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-60c47a64-9570-47c0-b8c6-1275f37dd009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:57.476636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:57.477590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:57.478516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:57.478516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:57.478516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:57.480177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 406/795] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:11:57.480929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bbdc-c48b-4182-b3a6-335fcb07cde4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.481208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bbdc-c48b-4182-b3a6-335fcb07cde4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.481484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0bbdc-c48b-4182-b3a6-335fcb07cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.487756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18a5b-966e-4390-8be5-32752756a6ce None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.502798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-acc0bbdc-c48b-4182-b3a6-335fcb07cde4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:57.504013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-acc0bbdc-c48b-4182-b3a6-335fcb07cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:57.530178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.531403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.531895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.532663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.533767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:57.534876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.537046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.551937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 390/796] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:57.553162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.585981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 407/797] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:11:57.587628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d74c6-46e6-4277-a139-80d64c03cac4 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.587914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d74c6-46e6-4277-a139-80d64c03cac4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.588186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d74c6-46e6-4277-a139-80d64c03cac4 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.593528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 408/798] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:57.593528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d74c6-46e6-4277-a139-80d64c03cac4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.608656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.636867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.688904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cdab5-d3ec-4e68-8de1-ebd8f8c4574a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.703874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d74c6-46e6-4277-a139-80d64c03cac4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.724827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.725740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.726196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.726676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.727495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:57.727969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.729517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c55585-47ca-4eab-897d-78f4d7317441 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.743768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 391/799] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:57.744478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:57.745114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.745393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.745706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.746140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:57.746616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:57.747055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:57.753780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:57.755475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:57.767044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:57.769188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:57.844941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 392/800] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:11:57.846091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.902692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:57.905953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:57.906898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:57.907860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:57.909731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 409/801] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:57.910567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:57.959574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6d596-52d7-4122-bbe3-63dc826679c8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:57.998957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.000243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.000769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.001496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.010582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.012406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.014497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.023755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82791b84-4118-4ba9-b0ce-87a46fc053ea None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:58.029686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:58.030863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:11:58.032018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:58.039607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 393/802] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:58.039607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.079637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.081352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.081857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.082877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.098711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:11:58.105710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:58.106672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:11:58.107514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:58.115361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 410/803] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:58.115361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.168125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cada0-cc65-4f13-a5c5-f431f1e276a2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.171382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.207607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.208215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.208493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.208762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.209452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:58.209755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.211231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.222979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03dfbf-c44b-4ee9-bb7f-55d0a6657af8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.228542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 394/804] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:58.228542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.259851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.265642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.266614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.267093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.267668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.269040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:58.269597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.270797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.289268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 411/805] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:58.290183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.337577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71007-c050-4c3f-abf2-e9cb6d865757 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.372113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.372723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.373000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.373270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.373934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:58.374262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.375633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.383833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 395/806] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:58.384625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.405107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbbcd7-a5f9-45ed-a753-48cf590f44a2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.416600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.445162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.445729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.446139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.446443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.447029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.448445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:58.458166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:58.459149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 13:11:58.459962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:58.464199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 412/807] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:58.464956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.496854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dbb04-bd49-4ca7-b405-7d59be5d070c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.522783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.533113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.533791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.534798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.535043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/a90385a931614a58ac3782a79b1a9457/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.537049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=a90385a931614a58ac3782a79b1a9457, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.538546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.566324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 396/808] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:11:58 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/a90385a931614a58ac3782a79b1a9457/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:11:58.567390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.593254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8d8b4-33db-476b-913e-672d8588ff22 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.654928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.655703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.657577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.657577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.674576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.695670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4da457-6e95-4c53-8e3d-b4da17a171b3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.742465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.744003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.744003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.744003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.751063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.752392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc6e3-fc69-471d-999e-23188a8679fe None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.758057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.759566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:58.777810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:58.779059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:58.780107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:58.780107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:58.780107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:58.780107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 397/809] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:58.780107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.820311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 413/810] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b535-ce93-4caf-816f-bb29d55bb9c7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b535-ce93-4caf-816f-bb29d55bb9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05b535-ce93-4caf-816f-bb29d55bb9c7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 414/811] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:11:58.874639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b535-ce93-4caf-816f-bb29d55bb9c7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.902525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea9d-cdd9-45b6-994a-ac9840678a59 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:58.944213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:58.944816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:58.945098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:58.945577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:58.946051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:58.946358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:58.947693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:58.958135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 398/812] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:58.958135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:58.961687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:58.987676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05b535-ce93-4caf-816f-bb29d55bb9c7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.026071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.026705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.026999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.027254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.028311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:59.028311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.029537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adb19a-ab2d-41ea-b297-3106487c509a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.047570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 415/813] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:59.047570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.047570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.047570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.067146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:11:59.068444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:11:59.069616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e0dc-d5f7-4850-b3d7-305daa585a77 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.078637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.106948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.107583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.107865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.108141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.120130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.121714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:11:59.136533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:59.137681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:11:59.138935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:11:59.138935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:11:59.138935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:59.143642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 399/814] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:59.144618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.148741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 416/815] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:11:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:11:59.149515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.216298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.267435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7746-f2d0-4a43-b640-918f892899db None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.284785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530faee3-1f7e-423a-bfc2-74f144b81f8d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.304546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.305286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.305674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.306075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.306833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:59.307241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.308707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.313900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 400/816] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:59.314844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.331964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.333090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.333543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.333979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.343926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.346514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:11:59.360588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:59.361737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:11:59.362957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:59.364740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 417/817] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:59.365701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.370231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.446080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfb9b3-6820-4540-aa1c-8b7dddd79442 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.464840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.480035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df42610-f2a8-460f-b507-b11130c85b8b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.483234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.483842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.484119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.484393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.485059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:59.485362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.486762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.504127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 401/818] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:59.504127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.516565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.517575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.518121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.519138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.519811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.521395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.546819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 418/819] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:11:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:11:59.547629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.629010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.636641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408d563-6176-467d-8b4d-bcf29417f089 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.694742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d6e20-9abb-4a2c-83d0-bb747493d081 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.695890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.696529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.696804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.697070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.698161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:11:59.698508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.701256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.723954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 402/820] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:11:59.725155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.756881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.757575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.757853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.758176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] PATH_INFO: `/v3/services/network` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.759165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.760290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.763730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:59.774497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:59.775726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 13:11:59.776632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:11:59.779300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 419/821] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:59.780369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.852580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc6859-6f1e-444b-b03b-cf9593ff5750 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.894938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.895954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.896493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.896969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.905087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.907031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:11:59.919705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:11:59.920632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:11:59.921558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:11:59.923278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b04b-6418-4dbe-9e20-df173675cd6e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:11:59.924209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 403/822] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:11:59.930569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:11:59.948424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:11:59.967320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:11:59.968045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:11:59.968781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:11:59.969131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:11:59.982899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:11:59.984734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:00.005749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:00.006931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:00.008048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:00.008048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:00.008048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:00.009058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 420/823] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:00.009986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.039204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.052725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b87f-b01a-4372-a599-f053b0abf8dd None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.095521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.097940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.098502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.098925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.099805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] RBAC: Adding query filter params (name=network) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.100323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.101901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.107485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 404/824] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:11:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:00.108680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.147252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c529-a98a-4468-a1ee-9af8d50ee337 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.184518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.185440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.185859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.186375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.187251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.187767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.189402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.206568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 421/825] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:00.207717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.225900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522016d3-dc04-4ef0-a9b8-92df52447208 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.242643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.268683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.269371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.269746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.270124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.271117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.271841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.273599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.290455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 405/826] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:00.291504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.315752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.325689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6dbe8-62f9-4787-bdc9-63ff843aea23 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.364476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.365347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.365789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.366280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.367135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] RBAC: Adding query filter params (type=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.367646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.369274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.375367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 422/827] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:00.376558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.420665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7ce5-9bc4-42e9-b601-39def7cc89a3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.465835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.466603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.467016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.467303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.468033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.468339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.469938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.482251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 406/828] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:00.482251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.489164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.500201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913e075-5460-4fae-ae12-bf72ae8b1f8f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.583590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.584616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.585117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.585592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.603432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.604289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.605446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:00.629136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:00.630302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:00.631462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:00.632734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af9401-fcef-4462-8125-c16ffa02cb5b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.640366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 423/829] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:00.646811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.687370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.688281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.688705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.689135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.689963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.692115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93a97a-7a42-4739-9207-0f67a36ff6df None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.747898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 407/830] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:00 2022] POST /identity/v3/endpoints => generated 337 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:00.772927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb9eba-68ee-45ae-b38d-7c91d1cbf330 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.773211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb9eba-68ee-45ae-b38d-7c91d1cbf330 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.773543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb9eba-68ee-45ae-b38d-7c91d1cbf330 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.776098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 408/831] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:00.790597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.791213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.791499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.804767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e1744-d7d6-40cc-b5dc-d6adfb0badfc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:00.817875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:00.819896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:00.861087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:00.861626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:00.861907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:00.862366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:00.863158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:00.863392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:00.865349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:00.879398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 424/832] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:00.886890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:00.903838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:00.918103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 409/833] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:01.016095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc374002-dffa-49e2-bc83-ffae3b62bc46 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:01.054444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:01.055117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.055398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.055676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/38bf5893ca6f4ee89cc56bdb1e839f75/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.071329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=38bf5893ca6f4ee89cc56bdb1e839f75, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:01.072771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:01.089213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 425/834] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:12:00 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/38bf5893ca6f4ee89cc56bdb1e839f75/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:12:01.242419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:01.320560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:01.360689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5766c-23dc-4f89-a8bc-21431e9ca945 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:01.396954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:01.397595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.397877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.398161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.409553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:01.414489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:01.415393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:01.416199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 410/835] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:12:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:01.424131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:01.489305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:01.530991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557053-0e33-438b-b8ab-8cd157c6585a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:01.567919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:01.568594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.568876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.569200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.569880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:01.570291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:01.571667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:01.580955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 426/836] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:01.586576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:01.696014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5daea0-ce70-478c-a734-a0a7ea94974f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:01.723196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:01.734038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:01.734713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.734994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.735269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.746691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:01.748146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-79006a26-6eaa-4e43-9a84-06d347bf322d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:01.764323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:01.765326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:01.766188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:01.766188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:01.766188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:01.766188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 411/837] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:01.773524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:01.888032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b793-59d9-499e-be9f-02d148a56e9b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:01.922235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:01.926887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:01.927636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.928035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.928355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.929009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:01.929316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:01.930770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:01.937542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b069-6508-475e-a1d9-816f62e49a7b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.937823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b069-6508-475e-a1d9-816f62e49a7b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.938094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b069-6508-475e-a1d9-816f62e49a7b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.941408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 412/838] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:01.944289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 427/839] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:01.945519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:01.945805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:01.946078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:01.950198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:01.971686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:01.972855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:02.070249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc3770-84c6-419d-8c36-45226c417f4b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.074359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 413/840] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:02.114166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.114751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.115031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.115301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.122851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.124543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:02.136678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:02.137617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 13:12:02.138597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:02.141130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 428/841] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:02.147315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.254595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e32fb-55a6-4d21-9ce0-461bd2dd92f6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.264981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.292880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.293802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.294340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.294836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.295755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:02.296256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.298018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.317912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 414/842] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:02.327291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.350634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.386669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.446022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40a222-60f3-4848-a534-f05bd7211866 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.480966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.481567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.481845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.482110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.483435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdde79-8070-4424-b9b7-bee0802a67d5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.522494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.523406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.523837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.524253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.525085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.526682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:02.537227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:02.538454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:02.539493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:02.541841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 415/843] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:02.554778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.555260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.556276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.587042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.610060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.662329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 429/844] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:02.666615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.668409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725ebcb-6d6c-4b30-95e8-f95582555b60 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.704985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.705619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.706006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.706359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.707165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:02.707557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.709016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.714563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 416/845] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:02.719651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.781409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb80fb-cf58-4119-a2b0-914c545e9391 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.824911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.825896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.826518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.827017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.842455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.844326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.845915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.849603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:02.860493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8273ed-3e10-4bdd-bf26-238315b7ce0e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:02.867071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:02.868012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:02.868920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:02.868920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:02.868920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:02.868920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 430/846] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:02.873593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:02.904566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:02.905250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:02.905807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:02.906108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:02.906791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:02.907567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:02.909919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:02.918351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 417/847] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:03.016731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba236343-0c16-4776-84f2-205587816b3f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.064756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.065934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.066912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.067193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.067872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:03.068176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.069610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d90bb-c3c1-4b3d-bb17-9d3963acf6c4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.084753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 431/848] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:03.090397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.163471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926834-7def-457c-a215-c4f5a2bd5c20 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.163816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926834-7def-457c-a215-c4f5a2bd5c20 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.164024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926834-7def-457c-a215-c4f5a2bd5c20 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.165848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 432/849] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:03.170822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.171046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.171316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.191460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:03.192595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:03.207265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc065103-f96f-4ce6-b391-8e118a3aae36 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.244594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.245514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.245958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.246513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.247313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:03.255973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.257792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.270385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 433/850] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-5a914661-1953-41e4-b0e2-a6a2c8b7cd69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:03.271334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:03.272401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:03.273510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:03.275755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 418/851] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:03.281856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.388108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96ae9f-834f-45ec-862f-a1823b4f9ea8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.397558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d36f-a8e5-45d6-89d3-48dd3058df7a None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.397830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d36f-a8e5-45d6-89d3-48dd3058df7a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.398101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d36f-a8e5-45d6-89d3-48dd3058df7a None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.403841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 419/852] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:03.404920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.405200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.405474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.423226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.423760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.424038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.424309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.425037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:03.425341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.425643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:03.427070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.427182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:03.442792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 434/853] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:03.443630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:03.451439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.510322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:03.517892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 420/854] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:03.567403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.570720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304eabd-6f85-47b0-a92d-696ef69cf40d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.607424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.608160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.608508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.608852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.609759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=a90385a931614a58ac3782a79b1a9457) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:03.610138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.611827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.619373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 435/855] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/role_assignments?user.id=a90385a931614a58ac3782a79b1a9457&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:03.683825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9cc4-ffd4-4795-970e-115dda50fcfd None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.728716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.729374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.729688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.729966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.730592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.731970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:03.742171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:03.743167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:03.744019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 421/856] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:03.750811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.793980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.814073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:03.883326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e9a7-b965-4060-91e4-78b9efb1930e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.898903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:03.926443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd885b-172f-4626-83b4-15da76f5533a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:03.930737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.931593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.932078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.932604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.933456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:03.934123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:03.935727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:03.942611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 436/857] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:03.954332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:03.968329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:03.969207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:03.969628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:03.970067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:03.981814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:03.988048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:03.989135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:12:03.990046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:03.992133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 422/858] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:03.997889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.071623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:04.071831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5357-eb8e-4615-8b73-ce351ee0dafc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.102492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56267bc3-ee42-4c0b-a04c-5a4c4eb8f433 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.110856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.111463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.111740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.112030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.113782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:04.114088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.115574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.126545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 437/859] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:04.140141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.141051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.141476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.141889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.142776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:04.143224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.144955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.155295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 423/860] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:04.162188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.207650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:04.273394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028872-df5e-4fb4-b771-d211b580087c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.310315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.310973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.311255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.311529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.323921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.325392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:04.341124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:04.342119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:04.343009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:04.343009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:04.343009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:04.343009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 438/861] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:04.349124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.458796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab0fe-3092-442c-a265-3ccac00f33b2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.497000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.497991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.498477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.498925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.499746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:04.500218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.501735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.504121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:04.515189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 424/862] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:04.520413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.615962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:04.626101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606b67-ae59-4303-adf6-fe1a86aaf68d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.661882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.662562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.662892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.663171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.670916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.672363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:04.689219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:04.690784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:04.691718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 439/863] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:12:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:04.693865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.805476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774e6c-8f4a-4332-931f-349b53769697 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:04.841365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:04.841976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:04.842272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:04.842547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:04.843333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:04.843645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:04.845066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:04.864374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 425/864] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:12:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:04.869682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:04.973683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06166942-55d3-45c9-8785-4abcc1eb9551 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.008975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.009595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.009871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.010143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.032484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:05.081323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.082941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff29e-57ff-4861-8f41-1eda16396008 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.197104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 440/865] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:05.202695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.263429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:05.314963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6fb12-9c99-4277-ac3f-4012b4e5cb91 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.336222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59584b-e1db-41eb-9d35-31e44a18f67e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.336508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59584b-e1db-41eb-9d35-31e44a18f67e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.336696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59584b-e1db-41eb-9d35-31e44a18f67e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.338277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 441/866] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:05.343291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.343570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.343844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.352697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.353340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.353620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.353892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.364144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:05.365092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.365350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:05.366573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:05.382660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:05.383622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:05.384904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:05.384904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:05.384904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:05.384904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 426/867] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:05.389505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.416703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:05.443254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 442/868] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:05.501322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b100-11e2-496c-8125-1c982aa874d6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.504448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:05.539227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.539903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.540186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.540460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.541099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:05.541402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.542818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.555384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 427/869] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:05.560819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.671357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d271ac-580d-42af-9703-da4a9c1d99d8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.708471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.709105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.709381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.709653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.717654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.719126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:05.731129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:05.733247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:05.735380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 443/870] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:05.738763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.752723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.808286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:05.875427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52cf91-ae47-4818-9ecc-de4de4141113 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.899175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85912-f898-46d5-a8f0-7f4d9f4bed4b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:05.934134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.935409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.935865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.936325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.937185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:05.937665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.938975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:05.939610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.939750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:05.939985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:05.941081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:05.941846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:05.943397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202dcf7-a153-43b1-aaa5-a0af839d2942 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:05.958166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 428/871] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:05.963882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 444/872] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:05 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:05.964973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:05.999695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:06.003669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6e65-a606-4c45-98a5-774cdea16250 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.004018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6e65-a606-4c45-98a5-774cdea16250 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.004294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6e65-a606-4c45-98a5-774cdea16250 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.010757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 445/873] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:06.012688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.012970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.013241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.041604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:06.042990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:06.109852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038d489-e0ed-42a0-9859-bb2d42ee1d5a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:06.142780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 446/874] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:06.153258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:06.153863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.154139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.154496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.155220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=38bf5893ca6f4ee89cc56bdb1e839f75) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:06.155575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:06.156993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b058a0-e796-47fe-8c9a-fe982730642e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:06.164660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 429/875] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:05 2022] GET /identity/v3/role_assignments?user.id=38bf5893ca6f4ee89cc56bdb1e839f75&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:06.408373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:06.419058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a929e7-cfbd-45f6-aea0-d835c181ca1c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.419347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a929e7-cfbd-45f6-aea0-d835c181ca1c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.419624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a929e7-cfbd-45f6-aea0-d835c181ca1c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.421621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 430/876] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:06.427702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.428026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.428255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.440418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:06.449265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:06.450609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:06.527017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bd512-010d-46c5-939a-1c63c4e5cb13 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:06.536978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 431/877] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:06.564694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:06.565363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.565643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.565916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.566539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:06.567902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:06.576901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:06.577881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:06.578940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 447/878] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:06.586808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:06.606785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:06.692341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fa68-ee65-49b3-ab11-4ef39a0d8d2d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:06.728217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:06.728832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.729114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.729389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.730026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:06.730361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:06.731726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:06.736639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 432/879] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:06.742574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:06.837504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:06.850390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:06.862277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c76bc-34e3-4321-bac9-5ad32853799b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:06.900899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:06.901512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.901791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.902059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.902984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:06.903693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:06.905343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99843c-6abc-494a-aff0-182bb1530972 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:06.910611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 448/880] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:06.927133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:06.949838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077988f-7945-4ac9-a09a-d588ca836cb8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:06.992487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:06.993122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:06.993405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:06.993746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:06.994494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:06.995961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac04a6d-03f0-4081-b903-d120ef512864 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:07.015424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 433/881] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:06 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:08.270936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8d147-2077-4cbf-82c5-48124cc27276 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.271965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8d147-2077-4cbf-82c5-48124cc27276 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.272461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8d147-2077-4cbf-82c5-48124cc27276 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.274241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 449/882] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:08.279822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fde3-1139-4708-a5f7-dc79371c2c99 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.280630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fde3-1139-4708-a5f7-dc79371c2c99 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.281111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23fde3-1139-4708-a5f7-dc79371c2c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.300214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9e23fde3-1139-4708-a5f7-dc79371c2c99 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:08.302047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9e23fde3-1139-4708-a5f7-dc79371c2c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:08.381411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 434/883] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:08.479819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b64-5b69-464a-8f84-53dc0bd1fd32 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.480138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b64-5b69-464a-8f84-53dc0bd1fd32 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.480383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51b64-5b69-464a-8f84-53dc0bd1fd32 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.481966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 450/884] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:08.487196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.487554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.487834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.506803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:08.507986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:08.573152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:08.580257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 435/885] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:08.656463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51b64-5b69-464a-8f84-53dc0bd1fd32 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:08.765086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51b64-5b69-464a-8f84-53dc0bd1fd32 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:08.800436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:08.801334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.801664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.801942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.802559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:08.803917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:08.818277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:08.819335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:08.820278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 451/886] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:08.827639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:08.885097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:08.906108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:08.943879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4654-ca55-4827-9d89-47ae9e9cbc33 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:08.994932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:08.995546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:08.995825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:08.996098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:08.996728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:08.997036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:08.998427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.009745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 436/887] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:09.009933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa881-2fcf-4f65-b22f-f6e80d9fc95a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.011310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.048702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.050119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.050533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.051195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.067249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:09.072096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:09.073121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:09.073968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:09.078293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 452/888] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:09.079090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.093669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.147359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f3d78-161b-4bbf-845b-e8b1add5c332 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.162157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.183272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.183883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.184164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.184460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.185065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:09.185361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.186763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2c4fa-c693-410d-be6d-ea939bde0444 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.187635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd22bf-aef8-4060-86f2-927406c191ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.196519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 437/889] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:09.196519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33051-1f27-4327-8a15-32dcc72ac976 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.196519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33051-1f27-4327-8a15-32dcc72ac976 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.196519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a33051-1f27-4327-8a15-32dcc72ac976 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.199435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 438/890] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:09.199435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33051-1f27-4327-8a15-32dcc72ac976 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.230485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.231427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.231709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.231985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.232679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:09.232991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.234427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5602b7-0eba-4e3c-8999-200c9df70adf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.248482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 453/891] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:09.248482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.248482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.248482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.264710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:09.265913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:09.316896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a33051-1f27-4327-8a15-32dcc72ac976 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.337311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 454/892] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:09.338087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.353686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.364906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.365946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.366383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.366658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.367496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] RBAC: Adding query filter params (interface=public, service_id=bebbe4e8e67045848a1e54ad10cd1b37, region_id=RegionOne) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:09.368102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.369734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b20f2-0cb7-4c3d-9004-6be9c2d7b011 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.380796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 439/893] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/endpoints?service_id=bebbe4e8e67045848a1e54ad10cd1b37&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:09.380796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146218-5fe1-4b24-966a-2ce693011a4b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.380796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146218-5fe1-4b24-966a-2ce693011a4b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.380796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81146218-5fe1-4b24-966a-2ce693011a4b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.381212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 440/894] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:09.382367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146218-5fe1-4b24-966a-2ce693011a4b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.411505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.445933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7175-b362-482f-86c8-731b34d7b384 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.483143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.483773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.484051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.484324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.492281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81146218-5fe1-4b24-966a-2ce693011a4b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.495154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.496585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-73b2711b-2539-4fc0-9295-3000a8073ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:09.512397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:09.513405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:09.514354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:09.514354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:09.514354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:09.514354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 455/895] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:09.515111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.515111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.515251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.532346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.532952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.533237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.533508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.534640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:09.534859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.535834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:09.536464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.542414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 441/896] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:12:09.543005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.608761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.627116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 456/897] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:09.628124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.661588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207e971-c04b-4909-9201-0cf0ba60c5e9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.699438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.705053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.706346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.706919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.707481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.708356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:09.708962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.710835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.731945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 442/898] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:09.733321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.757481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86520e9-2aee-45af-9288-ed28441dbcfa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.807781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.808458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.808743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.809017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.809939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.811953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.836261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 457/899] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:09 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:09.864257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963de82e-bcb3-4fce-a6f6-8902ead70a69 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:09.882299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:09.915835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:09.917005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:09.917299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:09.917575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:09.917915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:09.928370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:09.929844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:09.945008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:09.946015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:09.946984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 443/900] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:09.953653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.056599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae026c3-98f0-4ad4-8d0d-11dcecd4d7c9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.073370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.081836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd93a-6eca-43cd-b41b-be7dc3ec6a7e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.105712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.106388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.106671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.107041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.107643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.109075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:10.119585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:10.120536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:10.121408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 458/901] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:10.126237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.126237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.126237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.126237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.126646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:10.126646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.126811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.127480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.152968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 444/902] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:12:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:10.160068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.199822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.241817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827086f-ee9b-465b-b6f8-9369db7457de None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.279926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.280685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.281057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.281423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.282154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:10.282593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.284142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.294377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 459/903] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:10.295411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.296258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a433-973f-495c-a0e2-3c9426b89c32 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.334381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.335200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.335576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.335982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.353445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.418964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a056d3-cdb0-4d63-99e2-c5aeae7d3750 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.420075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.421943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.454490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.455320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.456214 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.456703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.457033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.457844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:10.458179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.459675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.469957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 460/904] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:10.470730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.539421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 445/905] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:10.546654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.575557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9aad9-4e03-4309-8f32-55574828130a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.578010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.611459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.612127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.612406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.612675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.613377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] RBAC: Adding query filter params (interface=public, service_id=8c6778584415451b860f934dbdbe241c, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:10.613682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.615100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.623220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 461/906] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/endpoints?service_id=8c6778584415451b860f934dbdbe241c&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:10.629130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.669383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ed75f-c468-4112-aa9f-40cc300c4012 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.700024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:10.709506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.710161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.710914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.710914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.721327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.723124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:10.739741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:10.740757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:10.741625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:10.741625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:10.741625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:10.745637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 446/907] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:10.746600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.751906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e82f-a3a8-449c-9304-a8ab75817016 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.793988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.795150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.795635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.796155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.797004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.798584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.814643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 462/908] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:12:10.862835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1095df7-19be-4967-aa3c-8f6182770952 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:10.902847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:10.903802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:10.904271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:10.904751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:10.905625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:10.906135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:10.907785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:10.922714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 447/909] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:10.934265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:10.965283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:11.041878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff83680-dd16-41e6-8efb-78994dc7b54c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:11.079230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:11.080249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:11.081305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:11.081804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:11.089031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:11.090717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:11.103110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:11.104028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:11.104896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:11.107346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 463/910] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:11.113319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:11.156094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:11.217786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87898343-805a-40d3-ac2e-4c053823abcc None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:11.253830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:11.254751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:11.255205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:11.255672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:11.256546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:11.257021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:11.258633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961ba7-2363-476a-a10c-5d331e3736ee None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:11.271609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 448/911] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:11.277762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:11.376187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:11.390449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c98cf-dd38-4d94-a93a-a2868f5acc76 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:11.430158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:11.430790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:11.431069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:11.431343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:11.432070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] RBAC: Adding query filter params (role.id=67b51f7dc2924bbbab03e0a399b349f2, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=38bf5893ca6f4ee89cc56bdb1e839f75) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:11.432439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:11.433868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f2b4a-e23c-49f8-b9b6-fad8eff61c70 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:11.439847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 464/912] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:11 2022] GET /identity/v3/role_assignments?user.id=38bf5893ca6f4ee89cc56bdb1e839f75&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=67b51f7dc2924bbbab03e0a399b349f2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:11.868151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809399-7bf3-4114-88e7-c94a86752f51 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:11.868686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809399-7bf3-4114-88e7-c94a86752f51 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:11.868686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809399-7bf3-4114-88e7-c94a86752f51 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:11.870320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 449/913] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:11.875594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffcd3-d21e-4970-8290-38bb567e22ae None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:11.875882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffcd3-d21e-4970-8290-38bb567e22ae None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:11.876161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffcd3-d21e-4970-8290-38bb567e22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:11.896170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-75cffcd3-d21e-4970-8290-38bb567e22ae None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:11.897372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-75cffcd3-d21e-4970-8290-38bb567e22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:11.972781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 465/914] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:12.138255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ece-a4ac-4652-817f-dd1127868175 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.138691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ece-a4ac-4652-817f-dd1127868175 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.139083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5ece-a4ac-4652-817f-dd1127868175 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.140791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 450/915] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:12.147089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.147501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.147879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.166979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:12.168182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:12.241278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 466/916] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:12.245916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5ece-a4ac-4652-817f-dd1127868175 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.352411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:12.356651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5ece-a4ac-4652-817f-dd1127868175 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.391473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.392358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.392892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.393902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.394906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.396459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:12.405555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:12.406731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 13:12:12.407557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.414060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 451/917] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:12.416459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.435456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:12.524971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.529859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299ceed-351b-46dd-9932-28fbccb43c1e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.568304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.569882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.570564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.571064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.571961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:12.572477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.574043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.580170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 467/918] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:12.587829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.637700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16f56-a679-4a4b-b2de-9fe21422f625 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.673753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.674336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.675208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.675477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.676297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.677825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.681640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:12.694652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:12.695721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:12.696588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:12.699454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 452/919] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:12.705027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.708329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24b7c2-8fc0-49e1-9c11-0ac3b8eaa790 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.741531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:12.753589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.754493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.754815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.755091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.755740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:12.756046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.757925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.769437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 468/920] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:12.771066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.838233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610008c-f066-4e74-ae6a-459016bf56a5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.877502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.878406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.878696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.878960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.879756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:12.880067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.881513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.887149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 453/921] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:12.893860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:12.901485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df666-38ee-4519-87fd-89934487a4cc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:12.942925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:12.943461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:12.943794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:12.944072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:12.944747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:12.946123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:12.963936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:12.972888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 469/922] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:13.035679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:13.049224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573b22-a6c6-483e-b246-149bc882fa56 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:13.099403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:13.100087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.100374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.100649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.101289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:13.101593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:13.103055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b242b-eafb-4bb3-a4d9-e34f6fe65429 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:13.109325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 454/923] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:13.116226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:13.141044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523ea-1606-49e5-9543-654b2c036dcc None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.141333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523ea-1606-49e5-9543-654b2c036dcc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.141598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523ea-1606-49e5-9543-654b2c036dcc None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.143276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 455/924] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:13.148849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.149123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.149398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.169206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:13.170537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:13.248174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474ce36-b2e0-41ef-a77f-364646dfb020 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:13.255583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 456/925] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:13.285599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:13.286206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.286518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.286790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.287494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] RBAC: Adding query filter params (interface=public, service_id=b24731bd6fb249a88821343a57ea6e0f, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:13.287865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:13.289224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:13.294731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 470/926] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:12:13 2022] GET /identity/v3/endpoints?service_id=b24731bd6fb249a88821343a57ea6e0f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:13.300700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:13.387595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:13.410895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228a8e9-ada9-4f75-9a99-b5e8548c44d8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:13.446839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:13.447887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.448373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.448864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.449742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:13.451468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefa73-4f4c-4c6b-9125-6372dd04524c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:13.464970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 457/927] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:13 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:12:13.535864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:13.610047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:13.642749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13115-91ce-424c-9269-b6c7bfc92e15 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.642749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13115-91ce-424c-9269-b6c7bfc92e15 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.642749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b13115-91ce-424c-9269-b6c7bfc92e15 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.644934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 458/928] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:13.649977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.650208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.650510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.653590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b979f-cd19-45bc-836b-a2563b164721 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:13.673921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:13.675288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:13.691920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:13.693203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.693640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.693920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.694545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:13.695998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:13.704879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:13.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:13.707513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 471/929] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Sep 9 13:12:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:13.711841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:13.752867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 459/930] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:13.836423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05322851-b262-4f40-af55-d1d2b68ec5ec None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:13.871465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:13.873225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:13.873851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:13.874371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:13.874724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:13.875276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:13.875584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:13.876961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:13.883109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 472/931] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:13.888920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:13.969816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:13.997408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd839-bdd2-4ff3-b56a-3b5d6129f441 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.038588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489152af-928a-4043-a32a-d051a642f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.039557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489152af-928a-4043-a32a-d051a642f482 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.040064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489152af-928a-4043-a32a-d051a642f482 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.040560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489152af-928a-4043-a32a-d051a642f482 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.041381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489152af-928a-4043-a32a-d051a642f482 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:14.041882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489152af-928a-4043-a32a-d051a642f482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:14.043477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489152af-928a-4043-a32a-d051a642f482 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:14.049319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 460/932] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:14.056002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.098557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489152af-928a-4043-a32a-d051a642f482 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.179638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c653e5-d128-431d-a545-acefe749c12c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.229734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.230404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.230741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.231024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.231970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:14.234049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:14.236022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489152af-928a-4043-a32a-d051a642f482 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.269517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 473/933] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:14.289011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.289725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.290003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.290298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.293542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:14.304439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:14.309730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:14.310827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:14.311648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:14.316182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 461/934] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:14.317761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.386599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:14.449680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fafaed-70e2-480d-8abd-5ce123b20640 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.485716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.486737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.487264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.487735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.488666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:14.489178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:14.490804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:14.499781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 474/935] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:14.505874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.609438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea388d63-35a4-4681-84ae-5a30d731c8c8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.647319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.647872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.648154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.648427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.660351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:14.661807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:14.677513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:14.678607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:14.679464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:14.679464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:14.679464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:14.683393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 462/936] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:14.685584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.791366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2baf7-f04f-4268-b52d-505364b8baaa None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.802875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:14.829801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.830493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.830774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.831590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:14.832444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:14.833173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:14.838237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:14.847601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 475/937] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:14.853318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:14.905743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:14.961952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09bbec-d241-4e10-a44e-77a12a44ce2c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:14.997946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:14.998661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:14.998942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:14.999214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.006907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.008339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:15.020359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:15.021278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:15.022730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 463/938] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:12:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:15.031353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.141607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3eea0-9809-47c6-bd51-bff459d66a5a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.177898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.178457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.178734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.179009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.179763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:15.180066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.181527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636879d1-2411-48d9-8877-a1a695c6fe47 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.203182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 476/939] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:15.211391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.311766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4842ea-2c94-4874-88d8-49e84e238211 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.312093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4842ea-2c94-4874-88d8-49e84e238211 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.312326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4842ea-2c94-4874-88d8-49e84e238211 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.314040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 477/940] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:15.320173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.320447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.320722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.322054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb98d05-2858-4812-bdfc-592127c62b86 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.333242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:15.342771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:15.344102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:15.367708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.369272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.370071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.370569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.371378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:15.388567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.390343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:15.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:15.410869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:15.411968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:15.411968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:15.411968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:15.414565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 464/941] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:15.423164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.428736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 478/942] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:15.531704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2565b2-bd29-4a81-a87d-b81b176113b2 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.567217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.568164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.568628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.569076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.569953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:15.570469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.572069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3741767-c4ee-4103-9e78-be373ca25c67 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.586658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 465/943] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:15.592585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.691992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c4ec-9658-480e-990d-186eafb8ad59 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.692177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c4ec-9658-480e-990d-186eafb8ad59 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.692468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714c4ec-9658-480e-990d-186eafb8ad59 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.694041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 466/944] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:15.700608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.700882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.701348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.704150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c5485-565f-4297-a99c-60fdde7a1a7a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.724232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:15.726062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:15.739418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.740112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.740394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.740685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.744853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:15.747524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.748960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:15.760354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:15.761237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:15.762163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.766290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 479/945] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:15.767051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.788500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:15.822374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 467/946] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:15.826138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.897458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219ce4d-c0ed-49b3-85f6-551d175946d8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.935620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.936334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.936688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:15.937051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:15.937752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:15.939278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:15.942809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING keystone.server.flask.common [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 13:12:15.944755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05376b4-a2e7-401a-9c5d-f8e87a1f545b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:15.962542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.sql.core [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 13:12:15.962542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 13:12:15.962542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [parameters: {'id': '46047f7bdbaa4ebdbfacb8571d6b9c53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 13:12:15.962542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81445) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46047f7bdbaa4ebdbfacb8571d6b9c53.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46047f7bdbaa4ebdbfacb8571d6b9c53. Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:12:15.981283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application result.read() Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 13:12:15.982154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application yield resource Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise self.value Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application session.commit() Sep 09 13:12:15.983155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self.session.flush() Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application compat.raise_( Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 13:12:15.984576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 13:12:15.985495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application result.read() Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:12:15.986316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [parameters: {'id': '46047f7bdbaa4ebdbfacb8571d6b9c53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.988220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:15.990235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 46047f7bdbaa4ebdbfacb8571d6b9c53. Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 480/947] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Sep 9 13:12:15 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:15.992467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:15.998332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:15.999326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:15.999900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.000373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.001351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:16.002050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.004447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.023546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 468/948] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:16.025180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.039455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.076940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.105119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96eefa-d395-4d77-8c2c-21fb7a430d48 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.141843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.142507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.142788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.143064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.148648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fccc9-5cd6-41c7-9c95-49b9bb9d69cc None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.152173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.153816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:16.166464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:16.167362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 481/949] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:16.168823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.188309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.188977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.189260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.189528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/38bf5893ca6f4ee89cc56bdb1e839f75/roles/67b51f7dc2924bbbab03e0a399b349f2` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.192554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=38bf5893ca6f4ee89cc56bdb1e839f75, role_id=67b51f7dc2924bbbab03e0a399b349f2)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.193894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.218253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 469/950] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:12:16 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/38bf5893ca6f4ee89cc56bdb1e839f75/roles/67b51f7dc2924bbbab03e0a399b349f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:12:16.218253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.305939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b171-aef2-48b9-a15f-abf7473e160d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.314050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.354521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.355613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.355902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.356448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.357069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.359153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.361286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9bb2a-4f0e-46b7-824d-488689b3cab4 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.361504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:16.372922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:16.374207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:16.375104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:16.378393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 482/951] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:16.381796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.410971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.411583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.411863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.412131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.412787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:16.413076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.414552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.436699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 470/952] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:16.512543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05656bb7-afa1-4027-b227-c7dc95031a3b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.553675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.554801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.555300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.555788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.556688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:16.557269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.558962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1fe88-3d25-473d-96ad-dbdf83fbf7e1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.568879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 483/953] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:16.575412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.684459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e486-2050-4fd0-9e1a-d7891b5479fe None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.684769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e486-2050-4fd0-9e1a-d7891b5479fe None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.685007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e486-2050-4fd0-9e1a-d7891b5479fe None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.686436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 484/954] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:16.692238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.692526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.692800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.692979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5243-34da-42ff-93eb-bf6dd50a094d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.714945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:16.716489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:16.725389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.732503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.733276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.733557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.734094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.734646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:16.734950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.736473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.742137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 471/955] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:16.748166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:16.787319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:16.801193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 485/956] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:16.871135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042e8e-08bf-4cfe-bb16-d419d5b26492 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:16.907703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:16.908373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:16.908658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:16.908956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:16.909890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:16.911303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:16.933455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 472/957] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:17.074082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:17.182155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d323c3-d05e-458f-bfa7-0994bd0045bf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:17.226137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:17.227033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:17.227453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:17.227864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:17.228580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:17.230089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:17.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:17.240461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:17.241543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:17.244071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 486/958] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:17.250145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:17.304557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:17.359283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086e1bb-d3d2-4362-8e6d-fc9fc964b679 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:17.394948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:17.395569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:17.395852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:17.396127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:17.396763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:17.397070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:17.398457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d0e8-d50a-421d-9ed8-72f375e2b435 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:17.403579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 473/959] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:17.408851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:17.464877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:17.517717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432ebd3-08e5-4438-9fce-9d58cda1e778 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:17.552323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:17.552929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:17.553254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:17.553534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:17.554162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:17.554493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:17.555856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18e661-58b8-486d-ade8-7be06ac25783 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:17.560850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 487/960] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:18.521723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227aa9-aa3a-41c7-9531-ebce95464e66 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:18.522288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227aa9-aa3a-41c7-9531-ebce95464e66 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:18.522288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227aa9-aa3a-41c7-9531-ebce95464e66 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:18.523882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 474/961] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:18.529418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50f37-450d-4e67-9722-7c06407b1c21 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:18.529822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50f37-450d-4e67-9722-7c06407b1c21 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:18.529992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe50f37-450d-4e67-9722-7c06407b1c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:18.548892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-efe50f37-450d-4e67-9722-7c06407b1c21 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:18.550193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-efe50f37-450d-4e67-9722-7c06407b1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:18.626329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 488/962] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:18.811575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc7ec-2649-44b5-84c0-78fe6b6e0b94 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:18.811876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc7ec-2649-44b5-84c0-78fe6b6e0b94 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:18.812057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc7ec-2649-44b5-84c0-78fe6b6e0b94 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:18.813682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 475/963] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:18.821809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:18.822100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:18.822411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:18.844845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:18.846319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:18.890920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:18.903916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc7ec-2649-44b5-84c0-78fe6b6e0b94 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:18.917467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 489/964] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:19.014458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc7ec-2649-44b5-84c0-78fe6b6e0b94 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.030578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.052402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.053028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.053299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.053568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.063783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:19.068455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:19.069372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.070234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 476/965] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:19.077222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.183794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722c9ef-4f10-49bc-8358-b9d833a5ec4c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.209784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.219151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.220153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.220639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.221140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.222813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:19.223385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.225151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.234720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 490/966] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:19.241692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.288265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.314970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b7a6c-92e6-47a3-8f20-5a8bde65a312 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.352778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.353391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.353673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.353948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.354732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.355707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12067fc-65d6-4123-a97f-8c24c6f4d13c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.356175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.358767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING keystone.server.flask.common [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 13:12:19.371423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.sql.core [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 13:12:19.371423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 13:12:19.371423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [parameters: {'user_id': 'e1235d40bb324852875a65e2ee153401', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 13:12:19.371423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81444) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-8edb5924-008d-479b-acdd-aa8cdd269eb1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result.read() Sep 09 13:12:19.379244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:12:19.380150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application yield resource Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application next(self.gen) Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise self.value Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application session.commit() Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 13:12:19.381128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.session.flush() Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application compat.raise_( Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 13:12:19.382591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 13:12:19.383466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application conn.query(q) Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application result.read() Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 13:12:19.385383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e1235d40bb324852875a65e2ee153401', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.392143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 13:12:19.394704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 477/967] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Sep 9 13:12:19 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eacae-ec33-4357-ad87-b60aef8dd859 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eacae-ec33-4357-ad87-b60aef8dd859 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.396865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3eacae-ec33-4357-ad87-b60aef8dd859 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.398348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 478/968] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:19.398348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3eacae-ec33-4357-ad87-b60aef8dd859 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.408749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.408749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.408749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.408749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.417770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.419235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.427361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-bbfb49cf-7915-4ce7-950c-2f9c17d22d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:19.436872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:19.437815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 491/969] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.442476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.460507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:19.461707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:19.503222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3eacae-ec33-4357-ad87-b60aef8dd859 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.531451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 492/970] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:19.532828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.547700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.549535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.550207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.550645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.556069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.564292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.566822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:19.583142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:19.584307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 13:12:19.585470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.592023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 479/971] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:19.593740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.655081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb637f3-1d6e-4d53-ae5d-bab3c11a31ce None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.693405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.694122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.694524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.695227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.695638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:19.696005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.697436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.710912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 493/972] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:19.716630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.733000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.742300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb28f97-4f82-48b5-8f6f-e324dcb6c1f7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.777945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.778708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.779062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.779427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.780189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:19.780565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.782063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aa012-cf01-40c2-9c9a-4cd1d799444f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.810661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:19.819472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 480/973] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:19.820665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cbbe-034a-432e-993b-fd9d7c464abd None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.820956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cbbe-034a-432e-993b-fd9d7c464abd None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.821228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491cbbe-034a-432e-993b-fd9d7c464abd None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.828856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 481/974] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:19.828856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491cbbe-034a-432e-993b-fd9d7c464abd None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:19.843474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7aee0-4f16-4dc8-abe7-b7dd31e7e101 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.882697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.883365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.883642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.883917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.894611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.896093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a00a359f-12f3-40cb-b0b2-0cb85cd94cd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:19.908518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:19.911632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 494/975] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909074be-9771-41e4-8836-795dda1b096d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.912580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909074be-9771-41e4-8836-795dda1b096d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.913374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909074be-9771-41e4-8836-795dda1b096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.932929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-909074be-9771-41e4-8836-795dda1b096d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:19.934149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-909074be-9771-41e4-8836-795dda1b096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:19.949676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491cbbe-034a-432e-993b-fd9d7c464abd None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:19.986579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:19.987778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:19.988068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:19.988383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:19.989581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:19.990999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:19.999981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:20.000987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:20.001847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 482/976] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:20.002831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.023608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 495/977] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:20.024716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909074be-9771-41e4-8836-795dda1b096d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.031458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.113233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.147617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adb886-39f2-4b7b-b04b-0c3c63f687a0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.156470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909074be-9771-41e4-8836-795dda1b096d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.184162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.185196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.185627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.186059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.186979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:20.187542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.189241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.192779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.193391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.193673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.193969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.194630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:20.194934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.196279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.201036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 496/978] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:20.207198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.215071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 483/979] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:20.220469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.300106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.314053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935e80-1828-4d1a-adba-79b7e3140b81 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.323390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85946-b685-4d8b-ba2d-7b5f626a0045 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.348852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.349461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.349735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.350123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.350787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:20.351091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.352446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.353789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.356820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.357414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.357689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.357955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.362614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 497/980] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:20.363791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.425672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.427554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.463887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005248a-d1bc-487c-b9c6-d356c2d481f7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.498767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.499362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.499641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.499752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.499914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.500547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.502455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.517256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 498/981] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:20 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:20.518038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.529069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 484/982] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:12:20.530199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.595491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.641551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9451-c529-4595-bc69-e14fe7055911 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.657322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62182-6640-41dd-89ad-f02dd9845879 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.681918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.682593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.682871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.683191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.694093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.695568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.701800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.702647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.702647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.702647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.703742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] RBAC: Adding query filter params (interface=admin, service_id=b24731bd6fb249a88821343a57ea6e0f, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:20.704051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.705492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.711985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 499/983] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/endpoints?service_id=b24731bd6fb249a88821343a57ea6e0f&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:20.713184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:20.714074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:20.715895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:20.715895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:20.715895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:20.715895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 485/984] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:20.717803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.719410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.750549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.832377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487b54-d060-4ebb-8a75-b377a681b78c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.843400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8d2a0-80ec-40cd-8108-ed5d7b7ad2d7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:20.862697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:20.871885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.872605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.872882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.873216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.873843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:20.874151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.875830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.880522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:20.881133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:20.881410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:20.881679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:20.882311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:20.884142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:20.892007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 486/985] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:20.892996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:20.896017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 500/986] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:12:20.991208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:21.005523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a54a-64a9-4644-94ec-78b0dad51504 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:21.042568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:21.043217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:21.043496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:21.043765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:21.052264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:21.053727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:21.065899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:21.066919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:21.067833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 487/987] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:21.073413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:21.179590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6aa27-4a35-4aaa-a1ad-8e651fe82b1e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:21.213232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:21.213838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:21.214111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:21.214403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:21.215094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:21.215392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:21.216796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeccd846-d3e1-4476-9fc2-e57a6c722b0d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:21.228863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 501/988] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:21.234611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:21.336029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a9e9-ff20-4c48-9e9e-384375486e86 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:21.369414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:21.370038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:21.370347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:21.370614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:21.371326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] RBAC: Adding query filter params (role.id=67b51f7dc2924bbbab03e0a399b349f2, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=38bf5893ca6f4ee89cc56bdb1e839f75) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:21.371630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:21.373037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a49d-44ae-4619-bcbc-987bef8057a5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:21.379553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 488/989] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:21 2022] GET /identity/v3/role_assignments?user.id=38bf5893ca6f4ee89cc56bdb1e839f75&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=67b51f7dc2924bbbab03e0a399b349f2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:22.732513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092ce8-9c12-4033-90d9-50295e705939 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:22.733037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092ce8-9c12-4033-90d9-50295e705939 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:22.733037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092ce8-9c12-4033-90d9-50295e705939 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:22.734553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 502/990] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:22.739796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d92a-a0ce-40e8-a78b-5dc132a10360 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:22.740172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d92a-a0ce-40e8-a78b-5dc132a10360 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:22.740351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d92a-a0ce-40e8-a78b-5dc132a10360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:22.759177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3fc7d92a-a0ce-40e8-a78b-5dc132a10360 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:22.760864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3fc7d92a-a0ce-40e8-a78b-5dc132a10360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:22.769715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:22.837238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 489/991] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:23.077209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b916fe-8713-4f06-a3a9-e765f7ac0d3f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.077500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b916fe-8713-4f06-a3a9-e765f7ac0d3f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.077678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b916fe-8713-4f06-a3a9-e765f7ac0d3f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.079078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 503/992] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:23.084867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.085158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.085438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.104400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:23.105587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:23.106172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b916fe-8713-4f06-a3a9-e765f7ac0d3f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.155148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.186415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 490/993] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:23.223103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b916fe-8713-4f06-a3a9-e765f7ac0d3f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.256572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.257283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.257573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.257848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.258467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.259826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:23.269076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:23.270033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:23.271324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 504/994] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:23.276122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.349778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.381575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2d960-5eea-4c13-9f26-c34404228444 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.420070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.420685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.420964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.421237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.421867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:23.422171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.423585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.433436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 491/995] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:23.435030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.452232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.542986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9e872-517b-4c21-8c69-40684d5bf0cf None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.550682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.563804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e77b3-0f46-4239-bdef-7ecf66c820d1 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.580108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.580715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.581614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.581894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.582556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:23.582856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.584224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7715-4736-4207-a4de-b7a47d281806 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.593726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 505/996] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:23.595907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7f2c-f093-4319-a532-933f3b22b331 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.596190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7f2c-f093-4319-a532-933f3b22b331 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.596992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7f2c-f093-4319-a532-933f3b22b331 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.598411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 506/997] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:23.599219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7f2c-f093-4319-a532-933f3b22b331 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.604533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.605110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.605392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.605664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.606276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.607645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.610373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f6bb4096-68b3-4f08-babc-b5a2d1eecff7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:23.618440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:23.619426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:23.620278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 492/998] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:23.621065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.621065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.621196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.638738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:23.639950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:23.704575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7f2c-f093-4319-a532-933f3b22b331 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.706512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 493/999] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:23.707339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.747560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.748656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.748947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.749222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.749925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] RBAC: Adding query filter params (interface=public, service_id=2df9c60ab6c1468ca5e58fe4e2211d98, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:23.750621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.752464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.762753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 507/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/endpoints?service_id=2df9c60ab6c1468ca5e58fe4e2211d98&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:23.764003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.804266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.810483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ed6e-dfc7-44b6-b09e-e1a088d976f7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.846128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:23.853051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.853669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.853950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.854243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.854935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:23.855188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.856637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.862771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 494/1001] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:23.868289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.886140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d46e-66de-4d39-a642-b06cee92e613 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:23.922589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:23.923612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:23.923951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:23.924243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:23.924806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:23.927162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:23.933697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 508/1002] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:12:23.981101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:23.981971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3768dad-d082-4494-92ba-7f7fd7d6dcb3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:24.023434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:24.024468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:24.024971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:24.025355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:24.026018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:24.026372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:24.027799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:24.038399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 495/1003] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:24.039820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:24.106700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:24.111704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:24.118678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3da48d-3d00-40c0-a989-5716e0805d56 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:24.156286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:24.157209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:24.157489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:24.157761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:24.158387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:24.160134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336e52-bd40-4b85-98a1-ec1d6e945667 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:24.160298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:24.169739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:24.170776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:24.172191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 509/1004] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Sep 9 13:12:23 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:24.177578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:24.202485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:24.203099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:24.203380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:24.203655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:24.204336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:24.205691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:24.223621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 496/1005] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:24.304479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59a19b-68e8-4ffd-8636-bd64de68a0e5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:24.348361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:24.348985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:24.349262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:24.349532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:24.350203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] RBAC: Adding query filter params (name=image) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:24.350532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:24.351919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a742b-c998-48f0-b012-0f52981bbb9c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:24.362187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 510/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:24.363178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:24.473167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d159e5-8e98-47c2-ab61-d8810d4cf2be None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:24.494416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:24.515638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:24.516245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:24.516520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:24.516786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:24.517408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] RBAC: Adding query filter params (type=image) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:24.517706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:24.519606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142cfb5-fe51-472c-91c0-bfd11362838f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:24.530308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 497/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:26.122604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192b0eb-5367-482b-b5fb-447365c0df87 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.123153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192b0eb-5367-482b-b5fb-447365c0df87 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.123153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192b0eb-5367-482b-b5fb-447365c0df87 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.124577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 511/1008] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:26.130240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84779-9462-4adb-a085-eee907004f19 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.130675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84779-9462-4adb-a085-eee907004f19 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.130774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84779-9462-4adb-a085-eee907004f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.149448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-58d84779-9462-4adb-a085-eee907004f19 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:26.150665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-58d84779-9462-4adb-a085-eee907004f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:26.222752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 498/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:26.419577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540181-916c-4d7f-92a4-28cb67db702d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.419771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540181-916c-4d7f-92a4-28cb67db702d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.420043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95540181-916c-4d7f-92a4-28cb67db702d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.421526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 512/1010] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:26.426974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.427261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.427537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.445885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:26.447103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:26.491389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540181-916c-4d7f-92a4-28cb67db702d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:26.516539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:26.516713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 499/1011] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:26.600553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95540181-916c-4d7f-92a4-28cb67db702d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:26.634084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:26.634746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.635025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.635297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.635880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:26.637238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-791c651b-45b7-422e-8998-c72cf73598b1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:26.646744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:26.647821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 13:12:26.648686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:26.650574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 513/1012] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:26.653701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:26.666408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5c58-fac7-4dab-831b-a71d4e958138 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.666687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5c58-fac7-4dab-831b-a71d4e958138 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.666959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf5c58-fac7-4dab-831b-a71d4e958138 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.668316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 514/1013] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:26.674086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.674341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.674732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.693598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:26.694810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:26.699455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:26.757779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00067e-b5d2-4075-990e-89f8b00db5ef None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:26.763466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 515/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:26.787080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:26.793689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014968-f635-4525-b54b-a1885df54170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:26.794515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014968-f635-4525-b54b-a1885df54170 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.794960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014968-f635-4525-b54b-a1885df54170 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.795492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014968-f635-4525-b54b-a1885df54170 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.796130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014968-f635-4525-b54b-a1885df54170 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:26.796435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014968-f635-4525-b54b-a1885df54170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:26.797796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014968-f635-4525-b54b-a1885df54170 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:26.806356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 500/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:26.809350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:26.809970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014968-f635-4525-b54b-a1885df54170 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:26.897846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba46d9-f39d-4598-bc98-4745e3555204 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:26.918438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014968-f635-4525-b54b-a1885df54170 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:26.925738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:26.936910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:26.937830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.938115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.938412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.939528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:26.941527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:26.943747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 516/1016] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:26.949124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:26.958535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:26.959561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:26.959861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:26.960142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:26.960773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:26.961072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:26.963150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:26.968266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 501/1017] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Sep 9 13:12:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:26.974456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:27.041802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:27.059073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13abb3-a195-4e30-80cd-1f3b80d02653 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:27.083095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3676e5-5a51-431d-9d74-f9bb3dd5bf2c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:27.093249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:27.093858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:27.094135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:27.094436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:27.095116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:27.096667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:27.117191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:27.117897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:27.118174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:27.118472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:27.119129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:27.120601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6423e34-d3cc-4c35-9279-754fd16fb04f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:27.123359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 517/1018] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:26 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:27.124151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:27.153466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 502/1019] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:27.252664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371663ce-ca14-4f63-9404-38d1105c9509 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:27.294746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:27.302135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:27.303020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:27.303342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:27.303790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:27.304670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:27.306119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb21ff-779e-461a-b26d-bb2ac6b4bef3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:27.323708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 518/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:27 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:29.370473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502c26b-52dd-48d3-84c2-bd0a41e1b3e3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.371029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502c26b-52dd-48d3-84c2-bd0a41e1b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.371029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502c26b-52dd-48d3-84c2-bd0a41e1b3e3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.372608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 503/1021] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:29.379563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ccd3-2f38-4f8f-b507-6ded84c9d4f5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.380082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ccd3-2f38-4f8f-b507-6ded84c9d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.380082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ccd3-2f38-4f8f-b507-6ded84c9d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.400171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d0b3ccd3-2f38-4f8f-b507-6ded84c9d4f5 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:29.401390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d0b3ccd3-2f38-4f8f-b507-6ded84c9d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:29.444214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d08fe-8cb5-4c49-9dca-b1c6efe38d43 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.444512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d08fe-8cb5-4c49-9dca-b1c6efe38d43 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.444778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d08fe-8cb5-4c49-9dca-b1c6efe38d43 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.446279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 504/1022] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:29.451027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.451316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.451592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.470330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:29.471568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:29.482627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 519/1023] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:29.489868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280605-d3f7-4453-8cee-00a78826be4f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.490153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280605-d3f7-4453-8cee-00a78826be4f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.490452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280605-d3f7-4453-8cee-00a78826be4f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.491984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 520/1024] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:29.494863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:29.497079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.497383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.497698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.521159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:29.522388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:29.554552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 505/1025] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:29.592172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 521/1026] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:29.755965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:29.815142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:29.862815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453a19-5a31-4881-b31d-ce074a745bb9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:29.871593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:29.897051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:29.897680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.897958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.898260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.899348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:29.900775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:29.903963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 506/1027] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:29.903963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:29.927698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17077b-34dc-4f7f-90b8-c7e8a14cc354 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:29.929532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:29.962014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:29.962673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:29.962957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:29.963225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:29.973224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:29.977968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:29.979099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:29.980109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 522/1028] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:29.980801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.010171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f7d96-c873-4f06-bb5d-60f25a08d029 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.042792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.043417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.043697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.043971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] PATH_INFO: `/v3/services/image` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.044551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.045946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:30.056453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:30.057585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:30.058462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 507/1029] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Sep 9 13:12:29 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:30.059235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.086412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f98e8-85c7-42d7-8b9b-5bd6e326fd2b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.095489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.122309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.122913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.123190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.123465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.124104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.125517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.162244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 523/1030] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:12:29 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:30.162244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.162542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.167744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3706004-56cd-44ab-b0f0-1a720992cd68 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.208912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.209557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.209837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.210106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.211257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.211570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.213658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.231310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 508/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:30.233014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.276461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8d4c-d7b5-44cd-a197-a8a1be2eb1d1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.314778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.316085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.316423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.316769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.317418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.317721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.319122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.329347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 524/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:30.330580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.351400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802a223-f646-4a99-baa6-6aa75a4d6778 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.364557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.395027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.395833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.396039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.396310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.408465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.410186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:30.424572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:30.425656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:30.426570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:30.426570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:30.426570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:30.426570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 509/1033] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:30.431797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.434994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.455056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957d7b1-f5ef-4af7-a8d9-6034e67debd8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.494601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.495212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.495494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.495767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.496400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] RBAC: Adding query filter params (type=image) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.496703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.498283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.508294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 525/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:30.509379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.538683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceacdfe-44d2-4807-9b02-eeb93aeb8848 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.573804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.574437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.574714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.574982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.575614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.575914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.577274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.589689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 510/1035] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:30.595463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.608103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.618521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f85f0-013b-46b4-be8b-7b190dde7842 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.657160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.657878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.658160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.658467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.659220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] RBAC: Adding query filter params (interface=public, service_id=330bbb7b8c854b33a53001b2ec67f0fa, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.659529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.659943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.662503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.669183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 526/1036] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/endpoints?service_id=330bbb7b8c854b33a53001b2ec67f0fa&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:30.674491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.708469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69100372-7353-4300-bf5f-20de40e65ae1 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.750271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.750897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.751174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.751440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.759536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.760977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:30.778206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:30.779218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:30.780162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 511/1037] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:30.785344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:30.786395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b983f-86d3-479d-87f8-646f69655b5c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.825627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.826165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.826470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.826748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.827352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.829057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.841058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 527/1038] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:12:30.920116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352055-85ee-4586-8437-be71e4747cf0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:30.946794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:30.960227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:30.960858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:30.961138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:30.961408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:30.962250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:30.962555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:30.964007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:30.989543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 512/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:30.991220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:31.019282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:31.131563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5bacd-90c7-415a-8a4e-fa92b53b9fa3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:31.179127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:31.179740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:31.180015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:31.180282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:31.263536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:31.265048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:31.287314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:31.367564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 528/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:31.373435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:31.477634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd5f5-f9a5-45fe-bf96-0e3c53e15dab None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:31.513248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:31.513875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:31.514147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:31.514438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:31.525302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:31.526762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:31.542373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:31.543360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:31.544247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:31.544247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:31.544247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:31.546527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 513/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:31.549082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:31.647333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73eb356-72fa-4d32-a191-03e41aa4b212 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:31.667428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:31.683843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:31.684470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:31.684744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:31.685009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:31.685643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:31.685945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:31.687327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:31.698708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 529/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:31.704008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:31.735112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:31.808021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6cc0-0604-466f-ba87-7898a24dd17e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:31.848627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:31.849247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:31.849521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:31.849844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:31.856561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:31.858100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:31.870572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:31.871520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:31.872425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:31.873559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 514/1043] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:31.877369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:31.978817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9f33f-8551-414c-93f0-7ddbc73ae2ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:32.012642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:32.013173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:32.013451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:32.013722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:32.014446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:32.014753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:32.016179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950d85-7444-49d9-9ae7-1b25a33c1a91 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:32.035847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 530/1044] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:32.036055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:32.131611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:32.141737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9d889-9717-4ebf-97d8-c3888b845165 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:32.177569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:32.178168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:32.178467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:32.178731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:32.179441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] RBAC: Adding query filter params (role.id=67b51f7dc2924bbbab03e0a399b349f2, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:32.179748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:32.181160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b2088-5003-406b-b26d-581c5a31bef4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:32.194309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 515/1045] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:32 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=67b51f7dc2924bbbab03e0a399b349f2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:32.434874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a175c-1a9f-4f3e-b6ba-0756304910a6 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:32.435212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a175c-1a9f-4f3e-b6ba-0756304910a6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:32.435335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a175c-1a9f-4f3e-b6ba-0756304910a6 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:32.436724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 531/1046] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:32.442677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:32.442974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:32.443249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:32.461789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:32.463001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:32.529703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 516/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:32.797890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a175c-1a9f-4f3e-b6ba-0756304910a6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:32.850147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:32.911026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a175c-1a9f-4f3e-b6ba-0756304910a6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:32.946611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:32.947236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:32.947511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:32.947780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:32.958069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8ad10882-91f3-4bbf-91a5-d478d0b3eb9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:32.962774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:32.963694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:32.964540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 532/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:32.971205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.067464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.084166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a850805-a056-44c5-8ec8-0ef1fea845f1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.111972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53f98-a28c-4e43-8ffc-9522b5a7c153 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.113000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53f98-a28c-4e43-8ffc-9522b5a7c153 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.113992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad53f98-a28c-4e43-8ffc-9522b5a7c153 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.115469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 533/1049] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:33.119054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.119661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.119937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.120203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.120708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.120865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:33.121117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.121216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.121466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.122513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.136315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 517/1050] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:33.137293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.142818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:33.144192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:33.212906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 534/1051] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:33.240180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6ca4f-1a44-4039-8ef2-a93cf8883404 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.272531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.273161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.273436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.273701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] PATH_INFO: `/v3/users/2f729f78b75a40c39c01eb7898b9e187` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.287475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] RBAC: Authorizing `identity:get_user(user_id=2f729f78b75a40c39c01eb7898b9e187)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.288900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.296752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 518/1052] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/users/2f729f78b75a40c39c01eb7898b9e187 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:33.296886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.326890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.397451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eda6c-1457-420a-943c-c9777fc38474 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.435440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.436040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.436412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.436685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.485571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.499678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.504931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.506535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.539386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.597284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdba65-e076-48ba-ac0e-15399263fdc0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.617682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 535/1053] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:12:33.623413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.635150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.635781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.636052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.636321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.636902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.638266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:33.647584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:33.648570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:33.649479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 519/1054] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:33.654550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.722835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.732981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97bf37-a5f2-46a0-874a-31380132614d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.754466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f195e-bace-48dc-b9f6-a284e63debe6 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.764951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.772625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.773444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.773872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.774516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.775795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.777584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.779821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 536/1055] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:33.790170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.797679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.798334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.798626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.798904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.799538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] RBAC: Adding query filter params (name=image) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:33.799873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.801248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.806650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 520/1056] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:33.812146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:33.912600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f0865-622b-46b7-9a54-de79361116ee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.919226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a559b-ec64-4823-b980-21692fe24583 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:33.949278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.949896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.950173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.950480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.951213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=1f354afc40954ef697805931ea8605fa, user.id=2f729f78b75a40c39c01eb7898b9e187) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:33.951524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.953119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.959448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:33.959691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 537/1057] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/role_assignments?user.id=2f729f78b75a40c39c01eb7898b9e187&scope.project.id=1f354afc40954ef697805931ea8605fa&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:33.960489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:33.960777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:33.961055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:33.961691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] RBAC: Adding query filter params (type=image) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:33.962003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:33.963438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ccb7-4d8f-4a9d-950c-91b301a5281b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:33.964917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:33.975365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 521/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:33.981010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:34.052287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:34.095119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b313bc-6fba-4eb0-aabd-388b73c03b32 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:34.132602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:34.133223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:34.133504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:34.133779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:34.134486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:34.136459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd792a-bf3d-48f1-abc2-ff3e390060c0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:34.159663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 538/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:12:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:12:34.338260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ab57-0445-4a45-8725-a25f8b597b67 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:34.338544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ab57-0445-4a45-8725-a25f8b597b67 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:34.338816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ab57-0445-4a45-8725-a25f8b597b67 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:34.340189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 522/1060] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:34.345347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:34.345803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:34.346078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:34.365418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:34.366677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:34.442587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 539/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:34.709481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ab57-0445-4a45-8725-a25f8b597b67 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:34.815143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ab57-0445-4a45-8725-a25f8b597b67 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:34.856767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:34.857399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:34.857677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:34.857947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:34.869033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:34.873828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:34.874769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:34.875609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:34.880108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 523/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:34.881337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:34.930585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:34.986692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6316f3f-8719-4971-af1a-e94e578d3252 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.020468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.021068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.021342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.021611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.022284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:35.022587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.023936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.036914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 540/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:35.038500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.102376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:35.144875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe151cf-e449-4504-958f-1fab9c364bb0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.178451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.179081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.179355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.179707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.189615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.191233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:35.205506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:35.207268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:35.212909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:35.212909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:35.212909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:35.212909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 524/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:35.213146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.311758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3be4ab-e55d-46bb-b420-d67f6aa928d4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.318519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:35.346386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.347714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.348005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.348262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.348899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:35.349195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.350578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.362179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 541/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:35.367592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.467141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2825f-664c-41ca-93f4-8a673fc926a5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.477411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:35.501422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.502058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.502379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.502738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.511040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.512459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:35.523952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:35.524869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:35.525807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:35.529892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 525/1066] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:35.530742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.629155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c61db9-e918-4312-a57a-6d685415f297 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.662101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.662725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.663002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.663271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.663991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:35.664294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.665695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.687216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 542/1067] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:35.688440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.789472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e97531-bfbd-44c8-bf51-4c550704bd14 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:35.833316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:35.833955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:35.834245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:35.834526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:35.845513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:35.847138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:35.861535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:35.863039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:35.868709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:35.868709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:35.868709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:35.868709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 526/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:35.869493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:35.896746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:35.977096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5aa05-779a-4000-985d-8a9ca9348653 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.014458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.015098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.015378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.015800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.016468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:36.016779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:36.018208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3559ff-c09a-4260-88c9-40865dc3b120 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:36.031477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 543/1069] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:36.037089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.064365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.123482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904d21-f568-4b50-a08f-486b69844b03 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.123767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904d21-f568-4b50-a08f-486b69844b03 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.124050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904d21-f568-4b50-a08f-486b69844b03 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.125387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 544/1070] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:36.131106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde565d-1b66-408d-b3a8-129ec2b350b4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.131388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde565d-1b66-408d-b3a8-129ec2b350b4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.131660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde565d-1b66-408d-b3a8-129ec2b350b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.149350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6adbae-99cd-4e98-9ffa-8f090d093d1f None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.150729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3fde565d-1b66-408d-b3a8-129ec2b350b4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:36.151944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3fde565d-1b66-408d-b3a8-129ec2b350b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:36.185074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.185700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.185983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.186277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.193562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:36.195044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:36.206701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:36.207578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:36.208693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 527/1071] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:36.214126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.225254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 545/1072] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:36.317417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.344813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fc6ff-84fa-4216-af23-634d61932400 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.380464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536bd-dd53-4b72-9728-f68acd1ad6e4 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.380797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536bd-dd53-4b72-9728-f68acd1ad6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.381010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2536bd-dd53-4b72-9728-f68acd1ad6e4 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.386274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 546/1073] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:36.387382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.388417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.388417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.401703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.402295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.402565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.403229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.404034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:36.404444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:36.406183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:36.406895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:36.408102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:36.418875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.426383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 528/1074] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:36.430998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.499519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 547/1075] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:36.500367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.555953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e435eb-3f86-4507-8abb-970ba16f0803 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.593426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.594078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.594389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.594660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/67b51f7dc2924bbbab03e0a399b349f2` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.598111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=9b8e7a5dbd3e42f0930b893394256697, role_id=67b51f7dc2924bbbab03e0a399b349f2)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:36.599583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:36.614728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88063d2-86fa-4348-87c5-6d93d2cdfb1a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.616632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 529/1076] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:12:36 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9b8e7a5dbd3e42f0930b893394256697/roles/67b51f7dc2924bbbab03e0a399b349f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:12:36.660335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.661468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.662040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.662543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.676307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:36.682197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:36.683282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:36.684141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:36.692013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 548/1077] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:36.693039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.696376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.766712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.771746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.813788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1418b3-44e6-40b0-a1cf-a212c465a62d None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.850420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.851040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.851324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.851595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.852256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:36.852560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:36.853932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:36.863440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 530/1078] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:36.868902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:36.900827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182867-e6ee-4ebc-954c-6a3e96923b9f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:36.936595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:36.937182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:36.937431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:36.937747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:36.938304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:36.978667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3598-8d68-4e48-a3ae-34b8341d0cd3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:37.013283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:37.013908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:37.014040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.014586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:37.014586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] PATH_INFO: `/v3/users/2f729f78b75a40c39c01eb7898b9e187` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:37.015425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.015603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] RBAC: Authorizing `identity:get_user(user_id=2f729f78b75a40c39c01eb7898b9e187)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.016974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.018337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:37.019231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 531/1079] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/users/2f729f78b75a40c39c01eb7898b9e187 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:37.024914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:37.127127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0f5a-53cf-4b81-bae0-3ea910aa887a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:37.129700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 549/1080] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:12:37.135399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:37.157802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:37.163821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:37.164462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:37.164745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:37.165018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:37.166144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.167606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.169551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 532/1081] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:37 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:37.175488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:37.244520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5587-d516-42d2-bfc1-321c5221f4d5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:37.246883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:37.282974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:37.283604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:37.283934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:37.284743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:37.286605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c3d93-d6f7-4c47-b92e-6704e666fdcf None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:37.295376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.296515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:37.312905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:37.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:37.314841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:37.314841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:37.314841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:37.314841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 550/1082] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:37.319592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:37.327062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:37.327727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:37.328015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:37.328292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa/users/2f729f78b75a40c39c01eb7898b9e187/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:37.330401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f354afc40954ef697805931ea8605fa, user_id=2f729f78b75a40c39c01eb7898b9e187, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.332381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cde82-3ed7-4b50-be90-4164038586f5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.346317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 533/1083] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:12:37 2022] PUT /identity/v3/projects/1f354afc40954ef697805931ea8605fa/users/2f729f78b75a40c39c01eb7898b9e187/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:12:37.439594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8086-9882-437f-9582-860f21936f5a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:37.476746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:37.477377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:37.477656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:37.477927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:37.478624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:37.478932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:37.480357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d68c4c-8043-42ae-8900-54d61f4b300d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:37.502340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 551/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:38.786481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995596c8-7e21-4be4-bf3f-df32bf8cc6a1 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:38.787151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995596c8-7e21-4be4-bf3f-df32bf8cc6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:38.787151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995596c8-7e21-4be4-bf3f-df32bf8cc6a1 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:38.788506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 534/1085] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:38.793593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:38.794005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:38.794296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:38.812443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:38.813634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:38.824586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:38.883854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 552/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:39.164301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995596c8-7e21-4be4-bf3f-df32bf8cc6a1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.223848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:39.266128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995596c8-7e21-4be4-bf3f-df32bf8cc6a1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.299183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.299838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.300112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.300470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.310591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:39.315837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:39.317015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:39.317946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 535/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:39.323179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.423319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8d855-1a77-46cd-bf87-836a96bcd5c9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.457429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.458029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.458339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.458612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.459272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:39.459574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:39.460929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6470-a130-4e32-a0c2-325ed93437f2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:39.468804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 553/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:39.474847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.493880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b521-2e28-4538-bdb0-06586b750ef6 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.494183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b521-2e28-4538-bdb0-06586b750ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.494498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451b521-2e28-4538-bdb0-06586b750ef6 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.495830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 554/1089] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:12:39.500808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.501092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.501365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.519638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:39.520829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:39.522788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:39.576835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954dc9-3bcc-4053-8c27-66dd433c37dd None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.588228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 555/1090] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:12:39.596500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:39.610587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.611208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.611485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.611751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.621901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:39.623359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:39.637788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:39.638820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:39.640159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:39.640159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:39.640159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:39.640159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 536/1091] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:39.644633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.739718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845bfdb-c27e-4e29-866a-edcf99070afd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.772644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.773235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.773508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.773774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.774434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:39.774732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:39.776075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:39.782189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:39.787874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 556/1092] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:39.793264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.861448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.896029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d76bc-23f5-4b40-a669-f98891ab1463 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.931044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.931673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.931950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.932218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:39.939447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:39.941535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:12:39.952525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:39.953527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:39.954502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 537/1093] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:12:39.959880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:39.963227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85b68-bcce-4e5d-ac1f-ef3fa44afb18 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:39.992217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:39.997207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:39.997839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:39.998114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:39.998410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.008860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:12:40.014061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:40.014990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:12:40.015853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 557/1094] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:40.021802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.064091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a98609-1ed4-4574-9949-56e6133f8f8c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.078436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.100612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.101212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.101491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.101759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.102508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:40.102810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.104227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.119889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27993a-86ff-4f81-8831-0287ca1ef249 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.121040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 538/1095] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Sep 9 13:12:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:40.126677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.155641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.156245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.156522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.156800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.157456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:40.157760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.159179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.168050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 558/1096] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:40.173946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.216764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.226870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076c8d4-7a01-4632-aca7-ec0693b60450 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.262332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.262867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.263146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.263418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.273724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d3066-d99a-490c-b028-0e429671ab9e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.293384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.309890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.310533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.310841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.311115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] PATH_INFO: `/v3/users/2f729f78b75a40c39c01eb7898b9e187` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.312441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] RBAC: Authorizing `identity:get_user(user_id=2f729f78b75a40c39c01eb7898b9e187)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.313863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.315983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 559/1097] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/users/2f729f78b75a40c39c01eb7898b9e187 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:40.321732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.330714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.332580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.418518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da0c94-81cc-498b-aa0d-bb00765a34c9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.419480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.430586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 539/1098] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:12:40.436248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.453376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.453979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.454281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.454557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.509667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.522563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.523943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.534320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d2394-880a-4200-ae2d-a71050838b81 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.568497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.569115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.569390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.569664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.579249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.580671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:12:40.594837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:40.595945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:12:40.597611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:12:40.597611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:12:40.597611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:40.597611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 540/1099] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:40.602152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.625736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 560/1100] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 13:12:40.631508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.644251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.702414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb5214-4eda-4441-961f-59d7af60a044 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.716973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.729977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2da5-3450-4a83-acfa-1a458680177b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.735956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.736562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.736844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.737246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.738392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:40.738695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.740062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.751949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 541/1101] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:40.758038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.763888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.764517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.764789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.765055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.766142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.767578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.774485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 561/1102] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:40.775320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.862100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01182b-e581-4203-bf08-f1ca0d060b02 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.864238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:40.877037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e132-daff-4641-b377-b9bb22cbaef7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:40.897196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.897828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.898109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.898422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.905023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.906485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.911919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:40.912520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:40.912804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:40.913075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:40.913793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=1f354afc40954ef697805931ea8605fa, user.id=2f729f78b75a40c39c01eb7898b9e187) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:40.914101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:40.915525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:40.921749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 562/1103] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/role_assignments?user.id=2f729f78b75a40c39c01eb7898b9e187&scope.project.id=1f354afc40954ef697805931ea8605fa&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:12:40.927006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:12:40.928388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:12:40.929328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 542/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:12:40.934778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:40.958730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:41.045127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0473f1e-cda4-4113-be98-a01e2669ad94 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:41.080717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:41.082420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:41.082874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:41.083150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:41.083857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:41.084164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:41.085598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750080b-64a5-4690-8c0a-82fd2b41a4da None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:41.099634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 563/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:41.105357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:41.206922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a72-c8e1-42f3-b998-0a406ab9d16a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:41.241215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45319013-3311-4d75-82de-074254ee349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:41.241820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45319013-3311-4d75-82de-074254ee349a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:41.242099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45319013-3311-4d75-82de-074254ee349a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:41.242402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45319013-3311-4d75-82de-074254ee349a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:41.243122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45319013-3311-4d75-82de-074254ee349a None admin] RBAC: Adding query filter params (role.id=67b51f7dc2924bbbab03e0a399b349f2, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9b8e7a5dbd3e42f0930b893394256697) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:41.243429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45319013-3311-4d75-82de-074254ee349a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:41.244892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45319013-3311-4d75-82de-074254ee349a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:41.250599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 543/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:41 2022] GET /identity/v3/role_assignments?user.id=9b8e7a5dbd3e42f0930b893394256697&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=67b51f7dc2924bbbab03e0a399b349f2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:43.105795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444db2-66fc-408f-aa75-0af320b8f863 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:43.106343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444db2-66fc-408f-aa75-0af320b8f863 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:43.106343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444db2-66fc-408f-aa75-0af320b8f863 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:43.107655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 564/1107] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:43.112874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:43.113314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:43.113427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:43.131549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:43.132711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:43.152696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:43.198484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 544/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:43.466516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444db2-66fc-408f-aa75-0af320b8f863 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:43.544815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:43.564562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444db2-66fc-408f-aa75-0af320b8f863 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:43.597757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:43.598395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:43.598674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:43.598945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:43.600044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:43.601462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1272dc-3753-4bb7-9604-de8808c51699 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:43.603027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 565/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:43.608722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:43.704026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fee48e-1e66-4d66-b099-4d82e9f28dce None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:43.736729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:43.738046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:43.738587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:43.738882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:43.739545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:43.740963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22007d-82f0-40d0-9aab-65ab4ed8790f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:43.761510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 545/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:12:43 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:45.942830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9b0b-6574-4854-af54-a1fdce207c68 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:45.943429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9b0b-6574-4854-af54-a1fdce207c68 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:45.943429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c9b0b-6574-4854-af54-a1fdce207c68 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:45.944733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 566/1111] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:45.950135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:45.950588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:45.950721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:45.969110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:45.970362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:45.977668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:46.039252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 546/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:46.309414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c9b0b-6574-4854-af54-a1fdce207c68 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:46.407493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c9b0b-6574-4854-af54-a1fdce207c68 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:46.440052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:46.441395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:46.441705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:46.441974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] PATH_INFO: `/v3/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:46.443385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] RBAC: Authorizing `identity:get_role(role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:46.444743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:46.446029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 567/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:46 2022] GET /identity/v3/roles/ee3812bbf20246aeb58841361e74fe32 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:46.451847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:46.549315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff67c-4174-4f16-8cee-beadec60ce0a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:46.583741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:46.584289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:46.584565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:46.584833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] PATH_INFO: `/v3/users/6d06c61ca6124923badd185b9247972b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:46.595277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:46.598710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] RBAC: Authorizing `identity:get_user(user_id=6d06c61ca6124923badd185b9247972b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:46.600457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:46.602502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 547/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:46 2022] GET /identity/v3/users/6d06c61ca6124923badd185b9247972b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:46.608041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:46.626304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:46.705138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e767123-bec1-40e1-aacd-50c74f75b3e6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:46.738023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:46.738717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:46.738997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:46.739266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:46.804392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:46.805821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:46.821713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:46.901053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 568/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:46.906872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:47.003030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51774ad3-7687-49e4-89b4-425780d63848 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:47.036620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:47.037240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:47.037520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:47.037792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:47.038911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:47.040329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938573c9-173e-48cc-a5c2-22a4cd90fc68 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:47.041934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 548/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:46 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:47.048233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:47.142139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3abe-06a2-4937-bd20-eb4c00539183 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:47.158030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:47.175751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:47.176336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:47.176611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:47.176876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:47.177834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=1f354afc40954ef697805931ea8605fa, user.id=6d06c61ca6124923badd185b9247972b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:47.178143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:47.179572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe4326-da78-4476-ab51-865e2749880e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:47.184659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 569/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:47 2022] GET /identity/v3/role_assignments?user.id=6d06c61ca6124923badd185b9247972b&scope.project.id=1f354afc40954ef697805931ea8605fa&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:49.267518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cc19-58f6-456b-86a0-16a3ee7cc850 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:49.268036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cc19-58f6-456b-86a0-16a3ee7cc850 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:49.268036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63cc19-58f6-456b-86a0-16a3ee7cc850 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:49.270119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 549/1118] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:49.275310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:49.275716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:49.275862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:49.294166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:49.295376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:49.358765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 570/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:49.626776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63cc19-58f6-456b-86a0-16a3ee7cc850 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:49.692349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:49.725726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63cc19-58f6-456b-86a0-16a3ee7cc850 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:49.757823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:49.758456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:49.758732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:49.759000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] PATH_INFO: `/v3/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:49.760347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] RBAC: Authorizing `identity:get_role(role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:49.761699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:49.763007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 550/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:49 2022] GET /identity/v3/roles/ee3812bbf20246aeb58841361e74fe32 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:49.769452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:49.864974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde7be-3338-4569-b439-f6e044d0e76e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:49.875153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:49.898537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:49.899100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:49.899378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:49.899650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] PATH_INFO: `/v3/users/6d06c61ca6124923badd185b9247972b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:49.900765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] RBAC: Authorizing `identity:get_user(user_id=6d06c61ca6124923badd185b9247972b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:49.902193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:49.903788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 571/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:49 2022] GET /identity/v3/users/6d06c61ca6124923badd185b9247972b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:49.910047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:50.006893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72f67-f4f6-4ff8-a26d-4727cb50a3b4 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:50.038598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:50.039209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:50.039484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:50.039751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:50.040835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:50.042276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631849-49fd-46ea-bcd2-c59e914dde1d None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:50.043863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 551/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:49 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:50.050504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:50.147365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d440-a059-4604-aaae-5f15c07cdc41 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:50.180630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:50.181212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:50.181488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:50.181758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa/users/6d06c61ca6124923badd185b9247972b/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:50.183855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=1f354afc40954ef697805931ea8605fa, user_id=6d06c61ca6124923badd185b9247972b, role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:50.185270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060968c-813d-4f71-aee8-4dc847936fbb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:50.198128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 572/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:12:50 2022] PUT /identity/v3/projects/1f354afc40954ef697805931ea8605fa/users/6d06c61ca6124923badd185b9247972b/roles/ee3812bbf20246aeb58841361e74fe32 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:12:52.293023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257511-2208-457e-884e-db5e7a7e28b3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:52.293544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257511-2208-457e-884e-db5e7a7e28b3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:52.293544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257511-2208-457e-884e-db5e7a7e28b3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:52.294919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 552/1124] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:52.300568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:52.300568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:52.301383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:52.319765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:52.320947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:52.349349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:52.386901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 573/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:52.656092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257511-2208-457e-884e-db5e7a7e28b3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:52.660432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:52.756436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257511-2208-457e-884e-db5e7a7e28b3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:52.789997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:52.790637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:52.790918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:52.791191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] PATH_INFO: `/v3/roles/ee3812bbf20246aeb58841361e74fe32` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:52.792571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] RBAC: Authorizing `identity:get_role(role_id=ee3812bbf20246aeb58841361e74fe32)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:52.793946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:52.795266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 553/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:52 2022] GET /identity/v3/roles/ee3812bbf20246aeb58841361e74fe32 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:52.801444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:52.896139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b359c2-cb18-442b-86dc-5464b636492d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:52.929261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:52.929819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:52.930098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:52.930398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] PATH_INFO: `/v3/users/6d06c61ca6124923badd185b9247972b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:52.931508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] RBAC: Authorizing `identity:get_user(user_id=6d06c61ca6124923badd185b9247972b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:52.932923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:52.934506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 574/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:12:52 2022] GET /identity/v3/users/6d06c61ca6124923badd185b9247972b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:12:52.940182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:53.008620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:53.038064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128699-433e-4c5f-bcf3-bb0663586b09 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:53.071551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:53.072153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:53.072432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:53.072702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:53.137429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:53.138893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:53.202832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:53.232561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 554/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:12:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:53.238515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:53.271816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:53.333178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6742-1aab-4319-b2bd-ddfc79735401 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:53.365870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:53.366513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:53.366791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:53.367060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] PATH_INFO: `/v3/projects/1f354afc40954ef697805931ea8605fa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:53.368165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] RBAC: Authorizing `identity:get_project(project_id=1f354afc40954ef697805931ea8605fa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:53.369603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6f69-4b94-4115-bac8-75163c9aa06b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:53.371240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 575/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:12:53 2022] GET /identity/v3/projects/1f354afc40954ef697805931ea8605fa => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:53.377266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:53.475021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b19e9-fcb9-4dd6-bd20-72f9d66acdee None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:53.507344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:53.507936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:53.508211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:53.508476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:53.509182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] RBAC: Adding query filter params (role.id=ee3812bbf20246aeb58841361e74fe32, scope.project.id=1f354afc40954ef697805931ea8605fa, user.id=6d06c61ca6124923badd185b9247972b) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:12:53.509483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:53.510919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66267bb8-622a-41b5-8a18-1e6998b1beb2 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:53.516434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 555/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:12:53 2022] GET /identity/v3/role_assignments?user.id=6d06c61ca6124923badd185b9247972b&scope.project.id=1f354afc40954ef697805931ea8605fa&role.id=ee3812bbf20246aeb58841361e74fe32 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:55.669598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0181f-3fbd-442e-8cc7-f216429e8bba None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:55.670138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0181f-3fbd-442e-8cc7-f216429e8bba None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:55.670138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0181f-3fbd-442e-8cc7-f216429e8bba None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:55.671525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 576/1131] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:55.678426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:55.678857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:55.678963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:55.697465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:55.698685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:55.728017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:55.769017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 556/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:56.090071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0181f-3fbd-442e-8cc7-f216429e8bba None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:56.201720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0181f-3fbd-442e-8cc7-f216429e8bba None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:56.204126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:56.238343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:56.238968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:56.239247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:56.239520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:56.240648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:56.242077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20404c1-a4ec-4f4d-b371-d6fba9a90a5e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:56.243689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 577/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:56.249812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:56.353392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07302647-6cc2-484e-be98-ec231ec52bc8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:56.390206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:56.391167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:56.391452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:56.391723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:56.392717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:56.394397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ee493-fc6a-4c8a-afcf-26622bf21f59 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:56.421708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 557/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:12:56 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:12:58.555708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b11ba-319e-493d-995b-e8ca66ca4bde None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:58.556340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b11ba-319e-493d-995b-e8ca66ca4bde None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:58.556340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b11ba-319e-493d-995b-e8ca66ca4bde None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:58.557587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 578/1135] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:12:58.563030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:58.563463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:58.563595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:58.582665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:12:58.583840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:12:58.596444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:58.650659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 558/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:12:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:12:58.922631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b11ba-319e-493d-995b-e8ca66ca4bde None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:59.021471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b11ba-319e-493d-995b-e8ca66ca4bde None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:59.055508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:59.056128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:59.056410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:59.056670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:59.057770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:59.059217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113738c-02b3-4595-b860-6629a7066a76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:59.060790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 579/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:12:59.067048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:12:59.162130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1fd3f-aa87-497b-9fe6-5bc9239a1b47 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:12:59.196039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:12:59.196636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:12:59.196914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:12:59.197183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:12:59.197823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:12:59.199268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88760a6-4ff8-4bd4-93e9-0e61beda32a7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:12:59.219236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 559/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:12:59 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:13:01.399341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f42c-1381-4f1b-bdc8-0cdf436b4497 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:01.399893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f42c-1381-4f1b-bdc8-0cdf436b4497 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:01.399893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f42c-1381-4f1b-bdc8-0cdf436b4497 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:01.401219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 580/1139] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:01.406565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:01.406933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:01.407122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:01.414488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:01.426911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:01.428085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:01.491854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 560/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:01.761411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f42c-1381-4f1b-bdc8-0cdf436b4497 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:01.803877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:01.860849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f42c-1381-4f1b-bdc8-0cdf436b4497 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:01.894592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:01.895208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:01.895486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:01.895754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:01.905327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:01.910647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:01.912051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:01.913224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:01.914396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 581/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:01.917714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:02.014372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed759f-013c-4307-9bed-b7ead5e6bb73 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:02.047510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:02.048107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:02.048387 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:02.048661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:02.049437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:02.049636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:02.051166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:02.052624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:02.060482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 561/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:13:02.067024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:02.163745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:02.166941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b4e6-0131-4c03-b2e3-a2bcdaa5b0c0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:02.200050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:02.200661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:02.200935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:02.201198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] PATH_INFO: `/v3/users/7971016000ad478093cbe5c97fd2cc24` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:02.214728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] RBAC: Authorizing `identity:get_user(user_id=7971016000ad478093cbe5c97fd2cc24)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:02.216142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:02.217693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 582/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:02 2022] GET /identity/v3/users/7971016000ad478093cbe5c97fd2cc24 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:02.224110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:02.321215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e436-95ed-4f9b-b32c-6aca34bf6e2a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:02.354345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:02.354943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:02.355221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:02.355491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:02.414193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:02.420972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:02.422453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:02.518030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 562/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:13:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:13:02.524188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:02.620936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccb0a4-f517-4faf-abde-03904187d8be None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:02.652766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:02.653382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:02.653660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:02.653926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] PATH_INFO: `/v3/projects/22bd960850fb4a2880d364626575310b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:02.655053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] RBAC: Authorizing `identity:get_project(project_id=22bd960850fb4a2880d364626575310b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:02.656466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb97652-5a7e-446c-bb92-6b1bc3b859a3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:02.658054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 583/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:02 2022] GET /identity/v3/projects/22bd960850fb4a2880d364626575310b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:02.664566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:02.754403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:02.760645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d671-432a-4ff9-a53b-33133b80e077 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:02.793301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:02.793884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:02.794157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:02.794452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:02.795165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=22bd960850fb4a2880d364626575310b, user.id=7971016000ad478093cbe5c97fd2cc24) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:02.795467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:02.796865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49ba93-2e45-439f-badb-735fc924fee0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:02.802294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 563/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:13:02 2022] GET /identity/v3/role_assignments?user.id=7971016000ad478093cbe5c97fd2cc24&scope.project.id=22bd960850fb4a2880d364626575310b&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:04.888883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713923a-4806-4acd-b7f4-2861268721dc None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:04.889379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713923a-4806-4acd-b7f4-2861268721dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:04.889490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713923a-4806-4acd-b7f4-2861268721dc None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:04.890786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 584/1147] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:04.896515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:04.896897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:04.897056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:04.914874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:04.916065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:04.979339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 564/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:05.245074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713923a-4806-4acd-b7f4-2861268721dc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:05.272413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:05.344166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713923a-4806-4acd-b7f4-2861268721dc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:05.377589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:05.378314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:05.378595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:05.378870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:05.388789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:05.393537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:05.395225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:05.396253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 585/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:05.400633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:05.489525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:05.499339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26f64-cc13-441c-b807-2ea5da5ed016 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:05.532329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:05.532916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:05.533191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:05.533457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:05.534105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:05.535366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:05.536727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:05.544429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 565/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:05.550937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:05.635990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:05.649572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924f71-eb58-46da-b74c-6f2dbfe71f1e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:05.682822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:05.683439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:05.683714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:05.683982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] PATH_INFO: `/v3/users/7971016000ad478093cbe5c97fd2cc24` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:05.685082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] RBAC: Authorizing `identity:get_user(user_id=7971016000ad478093cbe5c97fd2cc24)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:05.686529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:05.688077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 586/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:05 2022] GET /identity/v3/users/7971016000ad478093cbe5c97fd2cc24 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:05.693756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:05.789964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed1f06-2a50-46de-8401-8589a04c9e25 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:05.822143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:05.822785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:05.823061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:05.823327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] PATH_INFO: `/v3/projects/22bd960850fb4a2880d364626575310b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:05.824417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] RBAC: Authorizing `identity:get_project(project_id=22bd960850fb4a2880d364626575310b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:05.825819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18516f-c846-48b4-94b2-4d47586458be None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:05.827471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 566/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:05 2022] GET /identity/v3/projects/22bd960850fb4a2880d364626575310b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:05.833954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:05.931710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2450dd-f1c3-4b3d-88be-9993215cbe8c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:05.964609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:05.965256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:05.965532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:05.965804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] PATH_INFO: `/v3/projects/22bd960850fb4a2880d364626575310b/users/7971016000ad478093cbe5c97fd2cc24/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:05.967693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] RBAC: Authorizing `identity:create_grant(project_id=22bd960850fb4a2880d364626575310b, user_id=7971016000ad478093cbe5c97fd2cc24, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:05.969109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9771125-5eba-4e6d-8386-6c4a856c2d6b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:05.982313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 587/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:13:05 2022] PUT /identity/v3/projects/22bd960850fb4a2880d364626575310b/users/7971016000ad478093cbe5c97fd2cc24/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:13:08.120768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a0-9aae-43af-9d42-85646e3ec6cc None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:08.121271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a0-9aae-43af-9d42-85646e3ec6cc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:08.121271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948a0-9aae-43af-9d42-85646e3ec6cc None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:08.122584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 567/1154] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:08.127833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:08.128936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:08.129028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:08.147375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:08.148564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:08.157469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:08.214904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 588/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:08.485960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948a0-9aae-43af-9d42-85646e3ec6cc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:08.508370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:08.587064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948a0-9aae-43af-9d42-85646e3ec6cc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:08.626342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:08.626960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:08.627241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:08.627514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:08.637891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:08.642698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:08.644658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:13:08.645675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 568/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:08.650504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:08.745551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7c835-a266-48f8-8bef-84d7e2481758 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:08.778271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:08.778868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:08.779150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:08.779426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:08.780086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:08.780390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:08.781741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:08.789474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 589/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:08.795226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:08.875547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:08.895079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88df9-0430-4057-a4ca-11f9d94b02d7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:08.928510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:08.929379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:08.929656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:08.929926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] PATH_INFO: `/v3/users/7971016000ad478093cbe5c97fd2cc24` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:08.931073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] RBAC: Authorizing `identity:get_user(user_id=7971016000ad478093cbe5c97fd2cc24)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:08.932499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:08.934065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 569/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:08 2022] GET /identity/v3/users/7971016000ad478093cbe5c97fd2cc24 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:08.939807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:08.949402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:09.036076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae093-0886-4ffe-b244-134b5e1023f0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:09.068824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:09.069421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:09.069699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:09.069974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:09.134982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:09.136412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:09.143593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:09.230641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 590/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:13:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:13:09.236575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:09.333799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dfc39-6c20-4a02-8f05-426413685289 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:09.366519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:09.367136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:09.367413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:09.367683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] PATH_INFO: `/v3/projects/22bd960850fb4a2880d364626575310b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:09.368777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] RBAC: Authorizing `identity:get_project(project_id=22bd960850fb4a2880d364626575310b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:09.370196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c624d0-c3de-4680-9389-928a004e6af4 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:09.371825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 570/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:09 2022] GET /identity/v3/projects/22bd960850fb4a2880d364626575310b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:09.377937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:09.472589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acea84-0655-45ee-8f2d-95128ab11124 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:09.479539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:09.506000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:09.506636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:09.506912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:09.507183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:09.507898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=22bd960850fb4a2880d364626575310b, user.id=7971016000ad478093cbe5c97fd2cc24) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:09.508202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:09.509609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915fe7-0255-476e-819d-1f1bd37896ab None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:09.515152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 591/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:13:09 2022] GET /identity/v3/role_assignments?user.id=7971016000ad478093cbe5c97fd2cc24&scope.project.id=22bd960850fb4a2880d364626575310b&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:11.690734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78a0d-1183-42c8-a46d-0c347b23b02c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:11.691285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78a0d-1183-42c8-a46d-0c347b23b02c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:11.691528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78a0d-1183-42c8-a46d-0c347b23b02c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:11.692875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 571/1162] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:11.698036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:11.698436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:11.698627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:11.717234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:11.718437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:11.783127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 592/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:13:12.057628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c78a0d-1183-42c8-a46d-0c347b23b02c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:12.076070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:12.157943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c78a0d-1183-42c8-a46d-0c347b23b02c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:12.190312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:12.191401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:12.191677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:12.191948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:12.256822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:12.258288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:12.274826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:12.352879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 572/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:13:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:13:12.358679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:12.451128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:12.454057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef607e-9693-432b-89ef-ddf1c33e5f7e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:12.487090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:12.488300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:12.488576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:12.488847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:12.495440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:12.496873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9caef26b-6876-4e58-8a9d-329dee5e462e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:12.508590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:12.509818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:12.510918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 593/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:13:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:12.515780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:12.610281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c7f8e-7d89-4e5b-95b5-59de6de37aa3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:12.626831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:12.644722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:12.645312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:12.645591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:12.645862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:12.646518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:12.646818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:12.648173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826e304-396b-4e24-bcbc-0c459de0e543 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:12.655074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 573/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Sep 9 13:13:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:14.743850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0b32-93b9-46f0-9fac-83df91d39c37 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:14.744403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0b32-93b9-46f0-9fac-83df91d39c37 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:14.744403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef0b32-93b9-46f0-9fac-83df91d39c37 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:14.745713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 594/1167] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:14.750972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916817-1551-4ab7-b7c7-c1c8997f27a1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:14.751411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916817-1551-4ab7-b7c7-c1c8997f27a1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:14.751524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb916817-1551-4ab7-b7c7-c1c8997f27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:14.769908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bb916817-1551-4ab7-b7c7-c1c8997f27a1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:14.771109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bb916817-1551-4ab7-b7c7-c1c8997f27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:14.835703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 574/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:15.104881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0b32-93b9-46f0-9fac-83df91d39c37 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:15.202456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef0b32-93b9-46f0-9fac-83df91d39c37 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:15.234370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:15.234959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:15.235233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:15.235499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:15.236158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:15.237559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ea748-3a54-4a78-981e-424ec479e53f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:15.252566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 595/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Sep 9 13:13:15 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:13:17.420696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4a9-1a0c-49ae-8a14-f78430b24ed3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:17.421249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4a9-1a0c-49ae-8a14-f78430b24ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:17.421249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4a9-1a0c-49ae-8a14-f78430b24ed3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:17.422630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 575/1170] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:17.428170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:17.428610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:17.428715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:17.447105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:17.448268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:17.462274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:17.512918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 596/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:17.782313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac4a9-1a0c-49ae-8a14-f78430b24ed3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:17.882444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac4a9-1a0c-49ae-8a14-f78430b24ed3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:17.892641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:17.915178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:17.915794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:17.916071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:17.916342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] PATH_INFO: `/v3/domains/dca3e723e20b4213b864f5aef1fa8457` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:17.926989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dca3e723e20b4213b864f5aef1fa8457)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:17.928423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eecd61-6861-4a5a-9e87-f85c596b451c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:17.930268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 576/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Sep 9 13:13:17 2022] GET /identity/v3/domains/dca3e723e20b4213b864f5aef1fa8457 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:17.936140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:18.029826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771fdb5-fe70-49da-9444-bfdca28d332a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:18.063135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:18.063664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:18.063937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:18.064201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:18.064850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:18.066844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e85c-fb0d-4c75-afd1-cf6be0d7a23a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:18.091419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 597/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:13:17 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:13:20.260852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3a2e1-4a28-438e-a2d3-aa7ead96e3e5 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:20.261364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3a2e1-4a28-438e-a2d3-aa7ead96e3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:20.261456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3a2e1-4a28-438e-a2d3-aa7ead96e3e5 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:20.262765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 577/1174] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:20.267865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:20.268282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:20.268413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:20.274647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:20.287879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:20.289054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:20.355532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 598/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 13:13:20.623323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3a2e1-4a28-438e-a2d3-aa7ead96e3e5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:20.721178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3a2e1-4a28-438e-a2d3-aa7ead96e3e5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:20.754739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:20.755354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:20.755642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:20.755916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] PATH_INFO: `/v3/domains/dca3e723e20b4213b864f5aef1fa8457` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:20.757029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=dca3e723e20b4213b864f5aef1fa8457)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:20.758485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9e3a3-9967-4418-a3c8-c9b930cbcfb0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:20.760033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 578/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Sep 9 13:13:20 2022] GET /identity/v3/domains/dca3e723e20b4213b864f5aef1fa8457 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:20.765595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:20.860850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733878c-50e0-44e1-ac03-e7ca3092b471 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:20.888679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:20.894263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:20.895128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:20.895404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:20.895670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:20.896311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:20.897717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df253c9f-1b9c-4af0-9923-835d1d9b36ff None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:20.918650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 599/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:13:20 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:13:23.089329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f8ec-4f8b-4af8-aa19-fa7fd1cc5802 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:23.089840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f8ec-4f8b-4af8-aa19-fa7fd1cc5802 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:23.089840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f8ec-4f8b-4af8-aa19-fa7fd1cc5802 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:23.091166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 579/1178] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:23.096333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:23.096707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:23.096946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:23.115234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:23.116404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:23.180544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 600/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:23.460583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f8ec-4f8b-4af8-aa19-fa7fd1cc5802 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:23.500809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:23.559508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f8ec-4f8b-4af8-aa19-fa7fd1cc5802 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:23.591875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:23.592489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:23.592768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:23.593040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:23.603587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:23.608315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:23.609383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:13:23.610365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 580/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:23.616261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:23.709392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53590c24-1402-4121-b0df-0a8115d0ef62 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:23.726594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:23.743770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:23.744368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:23.744649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:23.744921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:23.745578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:23.745880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:23.747270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:23.755262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 601/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:23.761126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:23.855991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:23.860008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2451b-5a51-49d6-943a-6b15d0b915d3 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:23.893519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:23.894970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:23.895384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:23.895665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] PATH_INFO: `/v3/users/75649676185442ae8fdedb7865295a88` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:23.908078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] RBAC: Authorizing `identity:get_user(user_id=75649676185442ae8fdedb7865295a88)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:23.910079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:23.911689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 581/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:23 2022] GET /identity/v3/users/75649676185442ae8fdedb7865295a88 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:23.917614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:24.013585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80b7a0-2ed3-4b84-a679-0b1f507dca89 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:24.046477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:24.047070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:24.047350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:24.047624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:24.093815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:24.113396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:24.114860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:24.208403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 602/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:13:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:13:24.214446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:24.309866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831db5f-8204-41ee-ac38-acdb2843a410 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:24.344011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:24.344631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:24.344913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:24.345187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] PATH_INFO: `/v3/projects/6fddee71288444d0b8bfe0ac1259ef76` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:24.346311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] RBAC: Authorizing `identity:get_project(project_id=6fddee71288444d0b8bfe0ac1259ef76)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:24.347815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4dc25-5b32-4cc2-b562-ffc5c020cf91 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:24.349428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 582/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:24 2022] GET /identity/v3/projects/6fddee71288444d0b8bfe0ac1259ef76 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:24.355615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:24.433187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:24.452019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f58e6-44ce-460e-b9ca-b0dc35934e0c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:24.484524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:24.485110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:24.485385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:24.485650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:24.486399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=6fddee71288444d0b8bfe0ac1259ef76, user.id=75649676185442ae8fdedb7865295a88) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:24.486704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:24.488642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab703401-1e90-477d-b303-5959f349f9e0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:24.493779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 603/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:13:24 2022] GET /identity/v3/role_assignments?user.id=75649676185442ae8fdedb7865295a88&scope.project.id=6fddee71288444d0b8bfe0ac1259ef76&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:26.578263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb5d6-a03f-41a6-88df-9d469c052423 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:26.578864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb5d6-a03f-41a6-88df-9d469c052423 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:26.578864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcb5d6-a03f-41a6-88df-9d469c052423 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:26.580139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 583/1186] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:26.585340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:26.585731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:26.585889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:26.604171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:26.605376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:26.669252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 604/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:26.937710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb5d6-a03f-41a6-88df-9d469c052423 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:26.962809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:27.041137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcb5d6-a03f-41a6-88df-9d469c052423 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:27.073693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:27.074338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:27.074617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:27.074890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:27.085306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:27.089931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:27.091038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:13:27.092062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 584/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:27.097762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:27.167613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:27.192265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c0cc2-1507-408f-a91f-062225d9215c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:27.224343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:27.224931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:27.225204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:27.225471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:27.226118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:27.226448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:27.227793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:27.235433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 605/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:27.241244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:27.336688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:27.351945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ed575-3ed0-4442-b9cd-a785b9f6e7e5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:27.384281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:27.384896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:27.385173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:27.385443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] PATH_INFO: `/v3/users/75649676185442ae8fdedb7865295a88` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:27.386563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] RBAC: Authorizing `identity:get_user(user_id=75649676185442ae8fdedb7865295a88)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:27.387985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:27.389537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 585/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:27 2022] GET /identity/v3/users/75649676185442ae8fdedb7865295a88 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:27.396130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:27.491931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc155d-df9c-47d2-a881-af46e1148de3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:27.523877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:27.524495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:27.524775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:27.525050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] PATH_INFO: `/v3/projects/6fddee71288444d0b8bfe0ac1259ef76` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:27.526160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] RBAC: Authorizing `identity:get_project(project_id=6fddee71288444d0b8bfe0ac1259ef76)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:27.527607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1d5f2-2bde-49ce-b8e2-8dcdae80682b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:27.529203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 606/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:27 2022] GET /identity/v3/projects/6fddee71288444d0b8bfe0ac1259ef76 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:27.535473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:27.632587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6ead0-df1b-41e0-bb24-9cb4a758962a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:27.664245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9af27-6755-4958-a544-876430488484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:27.664886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9af27-6755-4958-a544-876430488484 None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:27.665164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9af27-6755-4958-a544-876430488484 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:27.665437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9af27-6755-4958-a544-876430488484 None admin] PATH_INFO: `/v3/projects/6fddee71288444d0b8bfe0ac1259ef76/users/75649676185442ae8fdedb7865295a88/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:27.667317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9af27-6755-4958-a544-876430488484 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fddee71288444d0b8bfe0ac1259ef76, user_id=75649676185442ae8fdedb7865295a88, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:27.668731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9af27-6755-4958-a544-876430488484 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:27.681904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 586/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:13:27 2022] PUT /identity/v3/projects/6fddee71288444d0b8bfe0ac1259ef76/users/75649676185442ae8fdedb7865295a88/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:13:29.785094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c9c9c-a40a-4f61-b10d-570f771dff52 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:29.785623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c9c9c-a40a-4f61-b10d-570f771dff52 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:29.785730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c9c9c-a40a-4f61-b10d-570f771dff52 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:29.787054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 607/1193] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:13:29.792183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:29.792553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:29.792736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:29.811583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:13:29.812772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:13:29.820888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:29.881612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 587/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:13:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:13:30.151080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c9c9c-a40a-4f61-b10d-570f771dff52 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:30.154860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:30.249854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c9c9c-a40a-4f61-b10d-570f771dff52 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:30.282454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:30.283074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:30.283354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:30.283629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:30.293799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:13:30.298569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:13:30.299641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:13:30.300871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 608/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:13:30.305970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:30.402099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebcdbc-9009-4f05-b943-9e453363c7db None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:30.434478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:30.435069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:30.435346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:30.435613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:30.436266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:30.436565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:30.437921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:30.446267 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 588/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:30.452217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:30.512946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:30.551043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275edd5e-dad1-4551-9fce-81f45e7c65fb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:30.583343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:30.583957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:30.584238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:30.584511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] PATH_INFO: `/v3/users/75649676185442ae8fdedb7865295a88` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:30.585614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=75649676185442ae8fdedb7865295a88)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:30.587061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:30.588602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 609/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Sep 9 13:13:30 2022] GET /identity/v3/users/75649676185442ae8fdedb7865295a88 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:30.594261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:30.597923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:30.690306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301099b0-2df1-4213-b9a6-ac4a41086a1b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:30.721981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:30.722600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:30.722876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:30.723143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:30.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:30.789162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:30.791640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:30.889183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 589/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:13:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:13:30.895530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:30.992613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd516d-ec46-405f-891c-28c03b250bf5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:31.020010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:31.025315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:31.025936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:31.026230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:31.026514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] PATH_INFO: `/v3/projects/6fddee71288444d0b8bfe0ac1259ef76` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:31.027618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] RBAC: Authorizing `identity:get_project(project_id=6fddee71288444d0b8bfe0ac1259ef76)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:31.029043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86f380-f2bd-42fc-8511-3c3cb1ee3c03 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:31.030698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 610/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Sep 9 13:13:30 2022] GET /identity/v3/projects/6fddee71288444d0b8bfe0ac1259ef76 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:31.037325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:13:31.132654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e6d56-b2d4-4b50-9b9a-7bc9b3f30351 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:13:31.134927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:31.166357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:13:31.166948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:13:31.167227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:13:31.167499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:13:31.168216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=6fddee71288444d0b8bfe0ac1259ef76, user.id=75649676185442ae8fdedb7865295a88) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:13:31.168523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:13:31.169947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a97c0-28ed-41b5-892f-fb38aab98012 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:13:31.176367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 590/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:13:31 2022] GET /identity/v3/role_assignments?user.id=75649676185442ae8fdedb7865295a88&scope.project.id=6fddee71288444d0b8bfe0ac1259ef76&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:13:41.173081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=16 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:26.985714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89cbe-fb98-4f4e-a1a8-156f9c857e8d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:26.986315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89cbe-fb98-4f4e-a1a8-156f9c857e8d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:26.986315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d89cbe-fb98-4f4e-a1a8-156f9c857e8d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:26.987809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 611/1201] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:26.994196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:26.994744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:26.994844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:27.017701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:27.019053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:27.122005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 591/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:27.407497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d89cbe-fb98-4f4e-a1a8-156f9c857e8d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:27.542506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d89cbe-fb98-4f4e-a1a8-156f9c857e8d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:27.583897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:27.584862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:27.585316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:27.585748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:27.597343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:27.599466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:27.624378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:27.625775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:27.627202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:27.627202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:27.627202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:27.634853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 612/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:27.635879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:27.761837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6140cf-e4b6-4d5f-9ee2-683a15681b80 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:27.804535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:27.818087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:27.818648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:27.819004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:27.819312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:27.820053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:27.820399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:27.822100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401ab8-ea90-4291-b5d7-b563b4c1fb8f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:27.841729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 592/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:14:27.848605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:27.917838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:27.994026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ad23e-9921-4435-92eb-1649122c53c7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:28.034253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:28.035632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:28.035983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:28.036255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:28.036922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:28.038398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d212f3-6d1e-48de-b519-95a4c836143d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:28.065297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 613/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Sep 9 13:14:27 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:14:30.472526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6999-230a-4672-8183-981fa1179e7a None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:30.474138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6999-230a-4672-8183-981fa1179e7a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:30.474138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6999-230a-4672-8183-981fa1179e7a None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:30.474702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 593/1206] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:30.482946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:30.483526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:30.483526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:30.505205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:30.506565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:30.590388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 614/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:30.853431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd6999-230a-4672-8183-981fa1179e7a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:30.974864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd6999-230a-4672-8183-981fa1179e7a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.014765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.015426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.016840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.016840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.028051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:31.033381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:31.034447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:31.035853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 594/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:31.046128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:31.088586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:31.155180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bbca-f4f6-4e3a-8c7d-99791f475ddc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.202414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.203209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.203647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.204051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.204875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:31.205396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:31.207397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:31.217993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 615/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:31.224417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:31.283585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:31.337016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2494a9-a0e2-40a5-ab6b-2c24cda49926 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.379338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.379338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.379712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.379712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.391123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:31.392751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:31.408878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:31.409982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:31.411602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:31.411602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:31.411602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:31.411602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 595/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:31.417188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:31.526658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:31.530381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d7316-3ab2-49fb-aa80-c6914ec563bb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.573022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.573626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.573901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.574172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.574846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:31.575146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:31.576499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:31.588956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 616/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:31.594866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:31.701045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c4156-866b-4f9d-9461-da1bce4d72bf None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.702639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:31.738975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.739783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.741137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.741137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.749557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:31.751306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:31.764785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:31.766045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:31.767392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:31.770943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 596/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:31.771907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:31.890871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30ed32-f4ae-43ee-8fb0-388a3c7a9459 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:31.938059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:31.938898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:31.939105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:31.939428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:31.940494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:31.940925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:31.944053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:31.965953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 617/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:31.971664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:32.111030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8d5c3-4aa1-4a3c-9f59-a047fe22556b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:32.158244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:32.159568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:32.161064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:32.161661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:32.201695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:32.250361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:32.252225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:32.380408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 597/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:14:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:14:32.386242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:32.410314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:32.498119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83d4d1-781b-40bd-a323-383cd9810f5b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:32.536426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:32.537093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:32.537343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:32.537516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:32.549292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:32.551205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:32.568504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:32.569519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:32.570481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:32.570481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:32.570481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:32.575062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 618/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:32.576113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:32.652446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:32.708799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876e3f-3000-4082-9e45-febb2fd8b351 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:32.761791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:32.762673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:32.763284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:32.763838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:32.764635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:32.765166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:32.767244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:32.783758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 598/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:32.792446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:32.878871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:32.917604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261a799-4b28-43ec-b0aa-e56ea7d24102 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:32.961382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:32.962060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:32.962374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:32.962650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:32.971065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:32.973459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:32.988780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:32.989979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:32.991059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 619/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:32.995944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:33.134055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b86e28-4350-4a2f-a170-11c2f634c753 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:33.160270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:33.173823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:33.174704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:33.174983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:33.175385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:33.176307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:33.176616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:33.178254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36877e-f305-4359-8a46-67e83624ac36 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:33.193189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 599/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:33.199345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:33.310248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4e02-6912-42a4-bb2d-5cea317db01d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:33.345937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:33.352689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:33.353304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:33.353579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:33.353878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:33.354600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9f10025eaa664fbc8fff276dfd1dafa0) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:33.354902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:33.356317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813864-f791-4643-a793-45773cf1fca0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:33.361907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 620/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:14:33 2022] GET /identity/v3/role_assignments?user.id=9f10025eaa664fbc8fff276dfd1dafa0&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:35.717055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb24e8c-c896-4b8d-8092-a57df0c27566 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:35.717641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb24e8c-c896-4b8d-8092-a57df0c27566 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:35.717749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb24e8c-c896-4b8d-8092-a57df0c27566 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:35.719159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 600/1220] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:35.725027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:35.725466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:35.725566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:35.746013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:35.747237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:35.825825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 621/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:36.112633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb24e8c-c896-4b8d-8092-a57df0c27566 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:36.236440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb24e8c-c896-4b8d-8092-a57df0c27566 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:36.275637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:36.276439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:36.276788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:36.277108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:36.291934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:36.297951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:36.299026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:36.302392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 601/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:36.306435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:36.410765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcfc7e-52a9-4611-8d9c-3e3c93a5afe1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:36.435357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:36.447637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:36.448245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:36.448524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:36.448802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:36.449459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:36.449760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:36.451152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:36.459585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 622/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:36.465499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:36.512709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:36.571778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b5b4-ca6a-4298-8f69-4c90ca087c26 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:36.608121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:36.608768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:36.609058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:36.609353 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:36.621409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:36.622980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:36.639188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:36.640540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:36.641572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:36.641572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:36.641572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:36.641572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 602/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:36.647455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:36.763739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936dcb1-eda6-4be2-b0d5-38d99ce19320 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:36.801853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:36.802549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:36.802891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:36.803166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:36.803989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:36.804276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:36.805732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:36.819386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 623/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:36.825375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:36.932512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:36.941651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7432a-b0a9-4eb9-a73e-fbce0f12c5e7 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:36.980384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:36.981191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:36.981476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:36.981746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:36.993258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:36.994751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:37.007504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:37.008511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:37.009795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 603/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:37.014702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:37.067972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:37.140891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085e9d-1497-412f-bb2c-79f0bc9242f2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:37.184152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:37.184916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:37.185196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:37.185695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:37.186690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:37.187121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:37.188817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.209589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 624/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:37.215501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:37.342519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57177fea-2242-4bcc-910e-7cc3a4d7ac66 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:37.380407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:37.380964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:37.381241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:37.381513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:37.392072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:37.393566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:37.408701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:37.409760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:37.411791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:37.411791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:37.411791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:37.411791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 604/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:37.416462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:37.532061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569af-8645-4e7c-834d-5fba19dff63b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:37.534707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:37.572787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:37.573379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:37.573655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:37.573925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:37.574592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:37.574895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:37.576281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.587628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 625/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:37.593632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:37.604151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:37.713080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a24b1-fb8c-4bcb-8b25-d2ff8031f66c None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:37.750236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:37.750872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:37.751149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:37.751417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:37.758935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:37.760544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:37.775610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:37.776524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:37.777421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 605/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:37.783427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:37.898302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dcc668-e06d-484f-bfd6-32d9d7d39c64 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:37.938395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:37.939383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:37.939696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:37.940026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:37.940940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:37.941310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:37.943193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d2a1-cdbc-4645-b3fa-dfb96946c95b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:37.957366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 626/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:37.964698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:38.038001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:38.087063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec384-454b-4f6d-8e64-be7091291118 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:38.128109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:38.129060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:38.129346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:38.129617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9f10025eaa664fbc8fff276dfd1dafa0/roles/3b754dd1b56c41a0bc8d5a25322ab9d6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:38.145473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=9f10025eaa664fbc8fff276dfd1dafa0, role_id=3b754dd1b56c41a0bc8d5a25322ab9d6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:38.147093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74a7f3-6e3b-410c-8feb-43ca195bbeff None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:38.161067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 606/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:14:37 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9f10025eaa664fbc8fff276dfd1dafa0/roles/3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:14:40.418123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783184-cb1f-4977-a32c-6a066c183f50 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:40.418923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783184-cb1f-4977-a32c-6a066c183f50 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:40.418923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5783184-cb1f-4977-a32c-6a066c183f50 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:40.421172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 627/1233] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:40.426945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:40.427585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:40.427585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:40.447682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:40.448867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:40.527022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 607/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:40.800140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783184-cb1f-4977-a32c-6a066c183f50 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:40.835399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:40.933932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5783184-cb1f-4977-a32c-6a066c183f50 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:40.972364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:40.973509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:40.973788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:40.974061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:40.984941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:40.991802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:40.992973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:40.993859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 628/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Sep 9 13:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:41.000597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:41.048403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:41.116924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88e0d-1430-4230-ba63-6434091d63c4 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:41.154550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:41.155195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:41.155590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:41.155892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:41.156595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:41.156901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:41.158295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:41.168797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 608/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Sep 9 13:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:14:41.174772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:41.278086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:41.297106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e2efd-46cf-4c0e-87f4-ea7eb6ec0381 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:41.337331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:41.337964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:41.338374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:41.338713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:41.350719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:41.352162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:41.367325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:41.368751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:41.370013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:41.370013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:41.370013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:41.370013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 629/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:41.374541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:41.492748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbdcf-221c-45c7-8ba0-397d86820fc9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:41.503312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:41.532454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:41.533110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:41.533393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:41.533709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:41.534471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:41.534818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:41.536293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:41.549640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 609/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:41.555590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:41.666381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac4eb-32e8-404b-8efb-0c2746e4bf27 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:41.702875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:41.703531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:41.703790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:41.704071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:41.707876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:41.713964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:41.715695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:41.727245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:41.728442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:41.729877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 630/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:41.734478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:41.844779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19206074-e382-4b1c-bcf9-71cccaa0eca5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:41.883663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:41.884427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:41.884781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:41.885098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:41.885902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:41.886197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:41.887809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:41.906409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 610/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:41.912862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:42.022512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bde93-9fee-42a1-b9cc-7f51ff1329d9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:42.061628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:42.062439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:42.063053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:42.063466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:42.137334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:42.144683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:42.146410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:42.255551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 631/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:14:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:14:42.261841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:42.294207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:42.375276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77818f0e-0cb3-43d4-8624-053eac5716d5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:42.415219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:42.415856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:42.416173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:42.416441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:42.427185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:42.428656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:42.444729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:42.446096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:42.447622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:42.447622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:42.447622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:42.447622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 611/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:42.451702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:42.554470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:42.561323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ebc49-27e4-4b3d-b603-1da78921d320 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:42.599732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:42.600344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:42.600623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:42.600901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:42.601544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:42.601850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:42.603253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:42.615329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 632/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:42.621438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:42.705785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:42.730481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73767dd-e046-4b26-ae3a-79d80b8a4f4a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:42.771032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:42.771674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:42.772016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:42.772381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:42.780040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:42.781798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:42.793839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:42.795035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:42.795905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 612/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:42.802336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:42.914496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc255e9-2780-44da-90c7-56473b0959d1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:42.952138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:42.952963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:42.953246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:42.953632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:42.954383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:42.954696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:42.956417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10ddd-6e2f-4229-bbac-bd86548c42ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:42.972251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 633/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:14:42.979859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:43.094441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae92631-59e7-410d-b5cf-d1d9420b1e1a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:43.135867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:43.136487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:43.136765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:43.137038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:43.137764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] RBAC: Adding query filter params (role.id=3b754dd1b56c41a0bc8d5a25322ab9d6, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9f10025eaa664fbc8fff276dfd1dafa0) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:43.138076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:43.139542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb4423-9478-4715-82a9-1c3aca9f708e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:43.145850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 613/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:14:42 2022] GET /identity/v3/role_assignments?user.id=9f10025eaa664fbc8fff276dfd1dafa0&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=3b754dd1b56c41a0bc8d5a25322ab9d6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:45.806141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683cc2c-8e40-4dc7-b018-4f827ca07388 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:45.806726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683cc2c-8e40-4dc7-b018-4f827ca07388 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:45.806829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683cc2c-8e40-4dc7-b018-4f827ca07388 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:45.808412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 634/1247] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:45.813794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:45.814203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:45.814379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:45.821207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:45.833757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:45.834994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:45.910293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 614/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:46.186834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683cc2c-8e40-4dc7-b018-4f827ca07388 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:46.205847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:46.301948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683cc2c-8e40-4dc7-b018-4f827ca07388 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:46.341005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:46.341635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:46.341924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:46.342174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:46.352196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:46.358066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:46.359241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:46.360084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 635/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:46.366680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:46.478322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443a5e6-ef2d-40a0-8935-3d68f03f0013 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:46.512697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:46.518781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:46.520038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:46.520409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:46.520813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:46.521598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:46.521901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:46.523413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:46.533327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 615/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:46.540168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:46.629984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:46.653767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0796f5-d9bf-4cd0-9be0-5273003f1131 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:46.689746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:46.690421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:46.690698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:46.690968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:46.702128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:46.703636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:46.719404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:46.720556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:46.721424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:46.721424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:46.721424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:46.721424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 636/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:46.727383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:46.835263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ab540-1373-4f5e-956b-5b2d510efdf8 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:46.871333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:46.871965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:46.872244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:46.872513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:46.873154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:46.873455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:46.874892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:46.888152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 616/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:46.894062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:46.997252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f2d4e-1331-4a0f-bc3c-834500e07260 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.024599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:47.032555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.033183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.033460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.033728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.042101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.043554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:47.054641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:47.055608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:47.056585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 637/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:47.062174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:47.130106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:47.177343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8529d-62be-48bb-81db-2572e48f88ff None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.211210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.211814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.212098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.212363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.213084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:47.213388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.214861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:47.232446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 617/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:47.238407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:47.335958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c4b89-03eb-4cd0-a959-dd151d29f585 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.368258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.368850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.369143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.369399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.422639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:47.435216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.436656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:47.531596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 638/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:14:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:14:47.537428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:47.632786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475d63-a42d-4bd3-8d68-79d134b0ae01 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.645777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:47.666293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.666911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.667189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.667460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.677198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.678790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:47.693527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:47.695415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:47.697538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:47.697538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:47.697538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:47.697538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 618/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:47.701555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:47.785026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:47.796651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944df85-2828-41c8-b962-37c51e1ed068 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.831092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.831691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.831966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.832265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.832898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:47.833196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.834565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:47.845306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 639/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:47.850995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:47.948714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4ca95-8334-441c-9fdb-71f3acbabe69 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:47.980719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:47.981326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:47.981600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:47.981866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:47.988232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:47.990514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:48.001104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:48.002100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:48.003349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 619/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:48.008575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:48.116508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67875c3-aa6e-4221-92cd-c1954be30f3d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:48.148116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:48.148712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:48.148987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:48.149254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:48.149963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:48.150287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:48.151696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3028f-06b4-4ac7-8e88-6e0ee47bd064 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:48.163625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 640/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:48.169688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:48.195087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:48.266174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b0b4-a97a-49af-87fc-a8c1fd5349f0 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:48.298538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:48.299126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:48.299404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:48.299673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:48.300381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9f10025eaa664fbc8fff276dfd1dafa0) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:48.300686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:48.302775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2b250-a231-49bb-8343-0897b6b4d94a None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:48.307929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 620/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:14:48 2022] GET /identity/v3/role_assignments?user.id=9f10025eaa664fbc8fff276dfd1dafa0&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:50.418633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a433-d185-4f2d-99d7-453ec5f37347 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:50.419197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a433-d185-4f2d-99d7-453ec5f37347 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:50.419197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40a433-d185-4f2d-99d7-453ec5f37347 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:50.420519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 641/1261] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:50.425891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:50.426333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:50.426601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:50.445094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:50.446319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:50.510656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 621/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:50.778705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40a433-d185-4f2d-99d7-453ec5f37347 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:50.789484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:50.880024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40a433-d185-4f2d-99d7-453ec5f37347 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:50.911620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:50.912236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:50.912510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:50.912779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:50.922384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:50.927634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:50.928843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:50.929886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 642/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:50.935088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:50.953385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:51.032671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53bc0a-d83f-423e-b6cb-622f0a266210 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.067082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.067798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.068078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.068403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.069048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:51.069318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.070710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.081310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 622/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:51.088937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:51.169606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:51.201973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3103-4879-48bf-aa98-3efd0e20a33d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.233902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.234548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.234822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.235087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.245135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.246591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:51.261145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:51.262272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:51.263192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:51.263192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:51.263192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:51.263192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 643/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:51.268011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:51.347434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:51.367330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612ea7f-b689-4e9c-90e1-83a755dd7539 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.399670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.400265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.400549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.400822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.401452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:51.401756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.403141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.415131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 623/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:51.420754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:51.520776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f95cd-6c80-486a-a1fc-7ee04c512727 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.540128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:51.554415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.555026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.555298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.555563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.562835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.564253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:51.575191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:51.576290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:51.577408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 644/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:51.581930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:51.679275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5cd1-925a-4a4d-b821-f6c39e163529 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.712150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.712732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.713012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.713289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.714001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:51.714333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.715755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.724604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:51.733474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 624/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:51.739566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:51.841742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e3f0c-9cf8-43ab-8bcf-7d3c3fd944b7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:51.873899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:51.874546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:51.874821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:51.875090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:51.885644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:51.887092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:51.900953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:51.902066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:51.903201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:51.903201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:51.903201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:51.903201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 645/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:51.907869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:52.006512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711e4e4-9138-4c0f-9c1a-8e56eb225ff1 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:52.039802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:52.040388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:52.040662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:52.040928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:52.041552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:52.041849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:52.043226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:52.054517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 625/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:52.060716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:52.099350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:52.165370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e57c6-c56b-4d87-8dfc-5bd227ea3d21 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:52.197583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:52.198196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:52.198502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:52.198772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:52.205087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:52.206544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:52.217928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:52.219050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:52.219925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 646/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 13:14:52.225294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:52.281850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:52.323332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776169-fe74-4fca-859e-ce2585d9cb32 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:52.354856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:52.355448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:52.355725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:52.355995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:52.356674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:52.356980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:52.358423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f7308-c43a-4adb-8fda-443e39a585f0 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:52.370362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 626/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:52.376332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:52.467443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:52.475925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942fef5-a95c-45af-9d3c-6590123052e8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:52.508989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:52.509633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:52.509911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:52.510182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] PATH_INFO: `/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9f10025eaa664fbc8fff276dfd1dafa0/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:52.512065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8ef8608cbd4262b00cde7d39b4e736, user_id=9f10025eaa664fbc8fff276dfd1dafa0, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:52.513477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fac336-bce7-4403-8069-1677b5e6d112 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:52.525553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 647/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Sep 9 13:14:52 2022] PUT /identity/v3/projects/2d8ef8608cbd4262b00cde7d39b4e736/users/9f10025eaa664fbc8fff276dfd1dafa0/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:14:54.634709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202b2f-9677-4e53-a9a6-0ad725ebfbf8 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:54.635239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202b2f-9677-4e53-a9a6-0ad725ebfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:54.635239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af202b2f-9677-4e53-a9a6-0ad725ebfbf8 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:54.636571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 627/1274] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:54.641706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:54.642088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:54.642289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:54.660902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:54.662080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:54.726609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 648/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:54.994932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202b2f-9677-4e53-a9a6-0ad725ebfbf8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.105207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af202b2f-9677-4e53-a9a6-0ad725ebfbf8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.127867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:55.146914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.147549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.147813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.148087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.157909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 13:14:55.163440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:55.164545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:55.165384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 628/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Sep 9 13:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:55.170586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.248848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:55.266853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1faa15-df1a-4f81-8abf-825801479eb7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.299535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.300129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.300405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.300673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.301436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:55.301736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:55.303105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:55.310986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 649/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:55.316768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.414016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52d204-cba6-415a-9ae8-5f9f9ce2f31a None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.447208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.447817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.448094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.448365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.458621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:55.460053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:55.475343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:55.476484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:55.477713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:55.477713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:55.477713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:55.477713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 629/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:55.482112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.578704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06838d50-f2c6-4f97-ab01-e3ad2e1a76f3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.611916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.612506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.612786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.613056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.613803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:55.614186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:55.615565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:55.626799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 650/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:55.633102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.663560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:55.730950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a955f6-ff20-411c-967f-93ef11ad264e None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.763383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.763999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.764278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.764546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.773126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:55.774589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 13:14:55.785555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:55.786751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:55.787738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 630/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:55.792480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:55.796174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:55.896316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dffb16-96c8-45fb-916a-7c10413b488b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:55.928537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:55.929128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:55.929405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:55.929680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:55.930429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:55.930735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:55.932146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:55.949244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 651/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:55.955086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:56.046497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:56.056803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8a68-ca64-4df7-9a56-62c5310c0301 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:56.091277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:56.091814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:56.092095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:56.092372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:56.158232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:56.159685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:56.245376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:56.255566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 631/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Sep 9 13:14:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 13:14:56.261508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:56.321462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:56.359415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395cb6-498b-4c51-949d-199eb1eedc52 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:56.392265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:56.392881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:56.393156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:56.393423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:56.403921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:56.405334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 13:14:56.420188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:56.421109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 13:14:56.422130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 13:14:56.422130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 13:14:56.422130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:56.422130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 652/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:56.427096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:56.523789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c457ffd-e092-456d-a21a-b8472d0392d5 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:56.559056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:56.559654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:56.559934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:56.560204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:56.560835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:56.561136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:56.562520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:56.573698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 632/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Sep 9 13:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:56.579381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:56.683224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fa334-f131-49e9-8fd1-61e3e8028dc7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:56.697615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:56.721022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:56.721653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:56.721931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:56.722202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:56.730472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:56.732541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 13:14:56.744531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:56.745625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 13:14:56.746751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 653/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Sep 9 13:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:56.751705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:56.805729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:56.860269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f366b-f082-4f70-9fd9-55606eddc89b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:56.896981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:56.897596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:56.897887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:56.898158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:56.898913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:56.899221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:56.900655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acc750-fe76-4f86-9386-0a662ab2242f None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:56.914442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 633/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Sep 9 13:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:56.920641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:57.026194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a8fe7-bf70-424e-9289-2d252e649556 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:57.064410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:57.065016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:57.065293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:57.065564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:57.066416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] RBAC: Adding query filter params (role.id=ccc3dd5a4fb844cf892abf5afcf4c03e, scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736, user.id=9f10025eaa664fbc8fff276dfd1dafa0) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:57.066829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:57.068407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1349-07fd-47fd-9b55-02dc327a54c6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:57.074687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 654/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Sep 9 13:14:56 2022] GET /identity/v3/role_assignments?user.id=9f10025eaa664fbc8fff276dfd1dafa0&scope.project.id=2d8ef8608cbd4262b00cde7d39b4e736&role.id=ccc3dd5a4fb844cf892abf5afcf4c03e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:59.253282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e641b1-3e2a-4200-be3c-7f9afc51462d None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:59.253790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e641b1-3e2a-4200-be3c-7f9afc51462d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:59.253903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e641b1-3e2a-4200-be3c-7f9afc51462d None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:59.255229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 634/1288] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:14:59.260324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:59.260732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:59.260871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:59.279165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:14:59.280335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:14:59.309714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:59.346917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 655/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:14:59.615706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e641b1-3e2a-4200-be3c-7f9afc51462d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:59.713753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e641b1-3e2a-4200-be3c-7f9afc51462d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:59.723967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:59.747238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:59.747847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:59.748122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:59.748388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:59.748951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:59.750331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:14:59.759411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:14:59.760727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:14:59.761912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 635/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:14:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:14:59.766390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:14:59.865343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bc147-f88b-4825-9a11-85e7977f9fdf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:14:59.898071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:14:59.898636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:14:59.898914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:14:59.899183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:14:59.899807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:14:59.900106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:14:59.901446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af42a35-617e-4e2b-99b7-5b30067a6ed9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:14:59.906047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 656/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Sep 9 13:14:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:14:59.912332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:00.009556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4a33b-7f3b-4f57-88ee-04f0801c283b None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:00.041539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:00.042126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:00.042436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:00.042705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] PATH_INFO: `/v3/services` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:00.043321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:15:00.043621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:00.044967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73979ca3-31d4-4764-856e-0c4a856f69e3 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:00.049229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 636/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Sep 9 13:14:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:15:02.196338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886858-ae00-43a7-afac-1f2ffc996702 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:02.196857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886858-ae00-43a7-afac-1f2ffc996702 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:02.196857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886858-ae00-43a7-afac-1f2ffc996702 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:02.198227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 657/1293] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:15:02.203574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e18c-c643-4ba8-b1bd-32c5ba7e3a3a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:02.203956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e18c-c643-4ba8-b1bd-32c5ba7e3a3a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:02.204130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e18c-c643-4ba8-b1bd-32c5ba7e3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:02.222624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4412e18c-c643-4ba8-b1bd-32c5ba7e3a3a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:15:02.224375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4412e18c-c643-4ba8-b1bd-32c5ba7e3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:15:02.252533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:02.289511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 637/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:15:02.560670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886858-ae00-43a7-afac-1f2ffc996702 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:02.591993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:02.660607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29886858-ae00-43a7-afac-1f2ffc996702 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:02.693127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:02.693702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:02.693977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:02.694267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:02.694922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:02.696262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f301-9e20-4c8b-8958-f46b39706302 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:02.710628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 658/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Sep 9 13:15:02 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:15:04.841550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd0c1-5975-4739-823b-bd8b11c3f05e None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:04.841951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd0c1-5975-4739-823b-bd8b11c3f05e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:04.842091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd0c1-5975-4739-823b-bd8b11c3f05e None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:04.843474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 638/1296] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:15:04.848691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:04.849100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:04.849230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:04.867747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:15:04.869005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:15:04.939351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 659/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:15:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:15:05.216919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fd0c1-5975-4739-823b-bd8b11c3f05e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:05.315876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fd0c1-5975-4739-823b-bd8b11c3f05e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:05.348671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:05.349357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:05.349637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:05.349907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:05.350507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:05.351865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:15:05.360293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:15:05.361429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:05.362299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 639/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:15:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:15:05.367395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:05.385431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:05.463159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9886c26-3c78-4ba5-a071-e8a2a102a701 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:05.494603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:05.495192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:05.495466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:05.495736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:05.496354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:15:05.496651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:05.497986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:05.502975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 660/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Sep 9 13:15:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:15:05.509366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:05.540281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:05.607941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916cf7-5e3a-4c67-857c-dd4b4a767af9 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:05.640209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:05.640797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:05.641074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:05.641343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:05.642025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] RBAC: Adding query filter params (interface=public, service_id=0bab111972034d889775b7d3f8ea5107, region_id=RegionOne) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:15:05.642362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:05.643714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a755e7-1afb-45c7-94bf-0619af601549 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:05.649090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 640/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Sep 9 13:15:05 2022] GET /identity/v3/endpoints?service_id=0bab111972034d889775b7d3f8ea5107&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:15:05.654683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:05.732421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:05.750376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b3804-96e4-4830-9c0b-d9d301be6256 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:05.782446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:05.783030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:05.783304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:05.783571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:05.784164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:05.785507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7e89a-edde-4f0c-ae45-7be3be618494 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:05.791989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 661/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Sep 9 13:15:05 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:15:07.917928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158819d-7a8d-4aa0-b4f3-e01a49f75486 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:07.918492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158819d-7a8d-4aa0-b4f3-e01a49f75486 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:07.918492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158819d-7a8d-4aa0-b4f3-e01a49f75486 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:07.919874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 641/1302] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:15:07.925096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:07.925478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:07.925648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:07.944322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:15:07.945510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:15:08.011039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 662/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:15:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 13:15:08.288322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158819d-7a8d-4aa0-b4f3-e01a49f75486 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:08.381874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:08.388710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158819d-7a8d-4aa0-b4f3-e01a49f75486 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:08.421860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709176-b667-4430-9944-136974f74f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:08.422504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709176-b667-4430-9944-136974f74f79 None admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:08.422784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709176-b667-4430-9944-136974f74f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:08.423055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709176-b667-4430-9944-136974f74f79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:08.423627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709176-b667-4430-9944-136974f74f79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:08.424982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709176-b667-4430-9944-136974f74f79 None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-1b709176-b667-4430-9944-136974f74f79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:15:08.434128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:15:08.435622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:15:08.436448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 642/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Sep 9 13:15:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 13:15:08.441617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:08.514603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:08.537026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931f133-0ef9-41e4-bf16-d80789af417e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:08.570191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:08.570763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:08.571044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:08.571315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:08.571943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:15:08.572248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:08.573600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feefda9-e720-4c42-9967-1d8f397764f8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:08.578571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 663/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Sep 9 13:15:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:15:08.584288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709176-b667-4430-9944-136974f74f79 None admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:15:08.680220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709176-b667-4430-9944-136974f74f79 None admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:15:08.712162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:15:08.712750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:15:08.713026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:15:08.713293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:15:08.713939 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:15:08.715317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc73d-9715-436e-ba21-f644f41bcb3b None admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:15:08.734848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 643/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:15:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:15:18.575765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=30 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:18.730498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:12.599409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14e65c-af41-4403-a52d-b025c278758e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:12.599879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14e65c-af41-4403-a52d-b025c278758e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:12.599959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14e65c-af41-4403-a52d-b025c278758e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:12.605264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 664/1307] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:12.606839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b70c3-e501-4aad-b9ac-22a011b4b9e9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:12.607624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b70c3-e501-4aad-b9ac-22a011b4b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:12.608064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b70c3-e501-4aad-b9ac-22a011b4b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:12.747835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c74b70c3-e501-4aad-b9ac-22a011b4b9e9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:12.750307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c74b70c3-e501-4aad-b9ac-22a011b4b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:12.908621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 644/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:16:13.211358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:13.211895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:13.212568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:13.214615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 665/1309] 10.222.0.42 () {54 vars in 965 bytes} [Fri Sep 9 13:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:13.220912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d22-e60a-4ba0-a303-facde11876a4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:13.221198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d22-e60a-4ba0-a303-facde11876a4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:13.221473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d22-e60a-4ba0-a303-facde11876a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:13.320735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4b3a0d22-e60a-4ba0-a303-facde11876a4 None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:13.321830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4b3a0d22-e60a-4ba0-a303-facde11876a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:13.346319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:13.440752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:13.443008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:13.446793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 645/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Sep 9 13:16:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:13.570537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b2c6-4863-4646-b7f7-398b95b73a0c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:13.654830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:13.655516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:13.655703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:13.656161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:13.657935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:13.720008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:13.781450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:13.783203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d2e2-e6e5-4f74-8e0c-b52faaf708be service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:13.804069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 666/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:16:16.275703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:16.276255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:16.276255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:16.277591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 646/1312] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:16.282860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4243-fc2c-4d21-8731-146f75b9937a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:16.283238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4243-fc2c-4d21-8731-146f75b9937a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:16.283417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d4243-fc2c-4d21-8731-146f75b9937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:16.364357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-807d4243-fc2c-4d21-8731-146f75b9937a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:16.365489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-807d4243-fc2c-4d21-8731-146f75b9937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:16.463545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 667/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:16.743919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:16.745437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:16.846816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52b01-a96b-4bb8-b009-040854964667 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:16.917075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:16.919460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:16.920299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:16.920750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:16.921222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:16.922892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:17.031408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:17.032771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc8007-a7c1-4e21-9f84-6a34db46fff7 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:17.052529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 647/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:19.511306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:19.511882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:19.511882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:19.513171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 668/1315] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:19.518380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d354f-fd78-4a24-8196-0e4f6226bdea None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:19.518801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d354f-fd78-4a24-8196-0e4f6226bdea None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:19.518921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d354f-fd78-4a24-8196-0e4f6226bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:19.582919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-042d354f-fd78-4a24-8196-0e4f6226bdea None None] MFA Rules not processed for user `bc3984f67b124d15a4a2d085a72ab521`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:19.584198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-042d354f-fd78-4a24-8196-0e4f6226bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:19.634693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:19.678844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 648/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:16:19.961349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:19.962904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:19.972582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:20.065578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf803ee8-bc71-4a44-9a4f-f189d185700e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:20.138715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:20.139247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:20.139522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:20.139790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:20.141372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:20.202172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:20.249414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:20.250898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ee05-e7ab-436c-a72f-c0d62b1d717b service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:20.268885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 669/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:22.964813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:22.965343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:22.965343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:22.966775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 649/1318] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:22.972000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1e7f-0148-4fe2-aa95-d94186419756 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:22.972441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1e7f-0148-4fe2-aa95-d94186419756 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:22.972549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1e7f-0148-4fe2-aa95-d94186419756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:23.036914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a0da1e7f-0148-4fe2-aa95-d94186419756 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:23.038126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a0da1e7f-0148-4fe2-aa95-d94186419756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:23.134068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 670/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:23.421893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:23.423449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:23.525540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168b3e-de20-49c0-9ad8-464377868248 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:23.599694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:23.600287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:23.600562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:23.600830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:23.602429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:23.609220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:23.710578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:23.711920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818e02-f56b-4bd2-9a15-4593f84769b6 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:23.729650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 650/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:26.506700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c65d6-872f-4542-a7e8-2db15ed96fd4 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:26.507239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c65d6-872f-4542-a7e8-2db15ed96fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:26.507239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c65d6-872f-4542-a7e8-2db15ed96fd4 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:26.508631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 671/1321] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:26.514077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1bb5-990a-4b2e-a9a6-dd2e69f75e33 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:26.514512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1bb5-990a-4b2e-a9a6-dd2e69f75e33 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:26.514670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1bb5-990a-4b2e-a9a6-dd2e69f75e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:26.586483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3b0b1bb5-990a-4b2e-a9a6-dd2e69f75e33 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:26.587743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3b0b1bb5-990a-4b2e-a9a6-dd2e69f75e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:26.652558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:26.697224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 651/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:26.994067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:26.994386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:26.994661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:26.995997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 672/1323] 10.222.0.42 () {54 vars in 965 bytes} [Fri Sep 9 13:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:27.001991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395569-082e-4d0e-9164-ab0cc87005bf None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:27.002385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395569-082e-4d0e-9164-ab0cc87005bf None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:27.002665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4395569-082e-4d0e-9164-ab0cc87005bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:27.081314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b4395569-082e-4d0e-9164-ab0cc87005bf None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:27.082465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b4395569-082e-4d0e-9164-ab0cc87005bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:27.156763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 652/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Fri Sep 9 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:16:27.166012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:27.167599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:27.189124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:27.272347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481c24-572c-4b67-bd43-e2e949c41a0e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:27.346802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:27.347344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:27.347623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:27.347896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:27.349705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:27.420436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:27.459315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:27.460739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9864010-b012-47ab-9e05-9b9c7415cb9d service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:27.478400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 673/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:29.931035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:29.931562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:29.931562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:29.932818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 653/1326] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:29.938170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394931b4-f7b1-40f7-b7d0-21e9bc5860d1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:29.938904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394931b4-f7b1-40f7-b7d0-21e9bc5860d1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:29.939020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394931b4-f7b1-40f7-b7d0-21e9bc5860d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:30.006044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-394931b4-f7b1-40f7-b7d0-21e9bc5860d1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:30.007273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-394931b4-f7b1-40f7-b7d0-21e9bc5860d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:30.105979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 674/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:30.383022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:30.384536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:30.447176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:30.498798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf485956-f5df-4948-8c63-573ef67bc41e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:30.572230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:30.572832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:30.573111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:30.573381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:30.575188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:30.682154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:30.684534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:30.686679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca1f5-bb64-425b-810f-e7013f863200 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:30.705820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 654/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:32.933550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:32.934056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:32.934174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:32.935477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 675/1329] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:32.941416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67160-e4bc-4268-b9cf-56e0af2eb3f1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:32.941895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67160-e4bc-4268-b9cf-56e0af2eb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:32.941978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf67160-e4bc-4268-b9cf-56e0af2eb3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:33.013182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3cf67160-e4bc-4268-b9cf-56e0af2eb3f1 None None] MFA Rules not processed for user `bc3984f67b124d15a4a2d085a72ab521`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:33.014422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3cf67160-e4bc-4268-b9cf-56e0af2eb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:33.116479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 655/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:33.403207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:33.404794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:33.436619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:33.510712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e0aed-d66e-4a62-af9b-20dc8712e891 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:33.589787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:33.590418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:33.590813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:33.591085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:33.592681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:33.671028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:33.704251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:33.705682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fbea1-193e-4a02-a029-2cb2290a2392 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:33.724984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 676/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:36.277557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:36.278107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:36.278107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:36.279516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 656/1332] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:36.284776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63846-7359-4f27-9978-4b9807bade2a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:36.285169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63846-7359-4f27-9978-4b9807bade2a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:36.285347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d63846-7359-4f27-9978-4b9807bade2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:36.350917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e6d63846-7359-4f27-9978-4b9807bade2a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:36.352115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e6d63846-7359-4f27-9978-4b9807bade2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:36.446701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 677/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:36.730021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:36.731592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:36.800603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:36.836231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b778b61-e23a-41ed-b79d-ed5cbf43e086 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:36.909486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:36.910084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:36.910395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:36.910671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:36.912814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:37.021934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:37.023407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01051-afa5-4a6a-a741-630406b00d1b service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:37.033140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:37.041962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 657/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:16:39.236213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:39.236771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:39.236771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:39.238098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 678/1335] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:39.243978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ff6d-0e9b-40a2-92e5-5ade997e4660 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:39.244393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ff6d-0e9b-40a2-92e5-5ade997e4660 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:39.244533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3ff6d-0e9b-40a2-92e5-5ade997e4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:39.309122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f9a3ff6d-0e9b-40a2-92e5-5ade997e4660 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:39.310348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f9a3ff6d-0e9b-40a2-92e5-5ade997e4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:39.404910 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 658/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:39.693818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:39.695423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:39.735008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:39.797203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7fd9b-ad5a-41fb-9acf-5c6f2c27115b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:39.871162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:39.871765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:39.872041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:39.872308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:39.873901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:39.956761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:39.981945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:39.983396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0faf52-e124-411e-a749-c8d46d93dca4 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:40.001289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 679/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:42.458122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:42.459321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:42.459516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:42.460771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 659/1338] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:42.465807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788701d1-45f1-4d08-96f6-0d9edcee7aa8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:42.466254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788701d1-45f1-4d08-96f6-0d9edcee7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:42.466382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788701d1-45f1-4d08-96f6-0d9edcee7aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:42.543155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-788701d1-45f1-4d08-96f6-0d9edcee7aa8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:42.544353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-788701d1-45f1-4d08-96f6-0d9edcee7aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:42.638839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 680/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:42.924736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:42.926335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:43.002836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:43.030454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f43b-e24a-4a70-bdf8-022f756d16d5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:43.104089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:43.104619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:43.104895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:43.105161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:43.106759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:43.216832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:43.218280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb769e-f8c8-4765-b7fd-f6d806d22d0a service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:43.236297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 660/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:47.452172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:47.452732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:47.452732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:47.454144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 681/1341] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:47.459817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bc44-6006-40af-8443-242e8846f3c3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:47.460275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bc44-6006-40af-8443-242e8846f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:47.460461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43bc44-6006-40af-8443-242e8846f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:47.465822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:47.528337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-dd43bc44-6006-40af-8443-242e8846f3c3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:47.529530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dd43bc44-6006-40af-8443-242e8846f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:47.627772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 661/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:47.911301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:47.913453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:47.963836 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:48.020048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d3851-e7c6-430b-9ac8-4e6a1c75c389 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:48.099514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:48.100045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:48.100321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:48.100592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:48.102190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:48.197203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:48.214849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:48.216285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a07e1-5e68-4c9a-a5e3-51cc33c71b37 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:48.235240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 682/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:16:51.023840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:51.024379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:51.024538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:51.025905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 662/1344] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:51.031122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1af46-9133-4edb-9c33-6b4fa829ab7a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:51.031571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1af46-9133-4edb-9c33-6b4fa829ab7a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:51.031708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1af46-9133-4edb-9c33-6b4fa829ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:51.100772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-62f1af46-9133-4edb-9c33-6b4fa829ab7a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:51.102047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-62f1af46-9133-4edb-9c33-6b4fa829ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:51.200793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 683/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:51.484018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:51.485622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:51.575199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:51.594768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e50c29-361b-4985-8828-de7b5e8d2360 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:51.670677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:51.671201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:51.671482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:51.671753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:51.673337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:51.786090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:51.787898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f213c-29d2-473e-ae4a-af55978e0dde service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:51.807033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 663/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:16:55.899500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:55.899977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:55.900180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:55.901651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 684/1347] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:16:55.907253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8fce-3d47-4b01-844b-fb5b18b5e446 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:55.907688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8fce-3d47-4b01-844b-fb5b18b5e446 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:55.907781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a8fce-3d47-4b01-844b-fb5b18b5e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:55.923449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:55.975030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-be9a8fce-3d47-4b01-844b-fb5b18b5e446 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:16:55.976266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-be9a8fce-3d47-4b01-844b-fb5b18b5e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:56.079421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 664/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:16:56.376169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:16:56.377702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:56.435861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:56.481374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e10c5-7ce3-47ef-a79b-54d1ff9a427c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:16:56.552988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:16:56.553592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:16:56.553870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:16:56.554141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:16:56.555752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:16:56.662856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:56.667023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:16:56.668492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ca69f-f0ad-4d63-a3bb-3097fa0be5ac service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:16:56.686302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 685/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:01.691171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09737317-e72e-43b4-9627-eba382d4d29c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:01.691618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09737317-e72e-43b4-9627-eba382d4d29c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:01.691698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09737317-e72e-43b4-9627-eba382d4d29c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:01.694735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 665/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:01.699979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7940-72cb-4c7a-a6f1-b52b6b2e8f4b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:01.700755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7940-72cb-4c7a-a6f1-b52b6b2e8f4b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:01.701041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7940-72cb-4c7a-a6f1-b52b6b2e8f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:01.804595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ef2b7940-72cb-4c7a-a6f1-b52b6b2e8f4b None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:01.805820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ef2b7940-72cb-4c7a-a6f1-b52b6b2e8f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:02.004118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 686/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:06.077262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=59 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:06.194148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18009-4f03-4b08-9679-a0e1fe8766c5 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:06.194824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18009-4f03-4b08-9679-a0e1fe8766c5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:06.195318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f18009-4f03-4b08-9679-a0e1fe8766c5 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:06.197397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 666/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:06.202927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dccc4b-812e-480a-b97e-ae3c1a6ca19a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:06.203418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dccc4b-812e-480a-b97e-ae3c1a6ca19a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:06.203499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dccc4b-812e-480a-b97e-ae3c1a6ca19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:06.259232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:06.284208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b7dccc4b-812e-480a-b97e-ae3c1a6ca19a None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:06.285526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b7dccc4b-812e-480a-b97e-ae3c1a6ca19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:06.395523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 687/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:07.728975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce23c36-57ce-4e91-bf58-b10fd330b850 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:07.729551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce23c36-57ce-4e91-bf58-b10fd330b850 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:07.729551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce23c36-57ce-4e91-bf58-b10fd330b850 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:07.730898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 667/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:07.735848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe47b-7ecd-4516-b0bc-e1c3b6eb8e5d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:07.736237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe47b-7ecd-4516-b0bc-e1c3b6eb8e5d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:07.736512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe47b-7ecd-4516-b0bc-e1c3b6eb8e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:07.818871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-33dbe47b-7ecd-4516-b0bc-e1c3b6eb8e5d None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:07.820125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-33dbe47b-7ecd-4516-b0bc-e1c3b6eb8e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:07.864168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:07.930910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 688/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:11.549226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bf9a-e635-4e4b-80b0-4b24e133147e None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:11.549741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bf9a-e635-4e4b-80b0-4b24e133147e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:11.549741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70bf9a-e635-4e4b-80b0-4b24e133147e None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:11.551284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 668/1356] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:17:11.560802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779521-2406-4a2b-bf6f-1f1c9f4740dd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:11.561731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779521-2406-4a2b-bf6f-1f1c9f4740dd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:11.562313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e779521-2406-4a2b-bf6f-1f1c9f4740dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:11.642282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7e779521-2406-4a2b-bf6f-1f1c9f4740dd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:11.643373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e779521-2406-4a2b-bf6f-1f1c9f4740dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:11.746250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 689/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:12.055220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:12.055962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:12.056469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:12.058867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 669/1358] 10.222.0.42 () {54 vars in 962 bytes} [Fri Sep 9 13:17:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:12.071888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aed38-48d0-4224-a17e-02e2839d4ca2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:12.072528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aed38-48d0-4224-a17e-02e2839d4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:12.073004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aed38-48d0-4224-a17e-02e2839d4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:12.092317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:12.158020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-937aed38-48d0-4224-a17e-02e2839d4ca2 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:12.159549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-937aed38-48d0-4224-a17e-02e2839d4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:12.285102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 690/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Sep 9 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:12.293700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:12.295339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:12.446897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075978f3-8672-4fef-bcd1-a198480d7930 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:12.523444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:12.566045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:12.566702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:12.567085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:12.567452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:12.569866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:12.667290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:12.669107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6163-db5c-46f6-b0d6-3ba756dc5f70 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:12.692533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 670/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:15.087133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:15.087700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:15.087700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:15.088924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 691/1361] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:15.094381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5f3-a3e7-46c3-9b0c-2c892552ef71 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:15.094962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5f3-a3e7-46c3-9b0c-2c892552ef71 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:15.094962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5f3-a3e7-46c3-9b0c-2c892552ef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:15.162757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-89afe5f3-a3e7-46c3-9b0c-2c892552ef71 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:15.163967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-89afe5f3-a3e7-46c3-9b0c-2c892552ef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:15.202628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:15.266990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 671/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:15.559883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:15.561385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:15.633358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:15.728634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa541aff-511f-4cf2-ad06-3af5b53f7024 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:15.871960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:15.872564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:15.872838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:15.873099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:15.875157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:15.901881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:15.973675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:15.976101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1aa0e-72a5-48de-9402-0c1d1a17426c service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:15.994988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 692/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:18.497337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f373-21c6-4745-b515-63db536eefe0 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:18.497884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f373-21c6-4745-b515-63db536eefe0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:18.497884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100f373-21c6-4745-b515-63db536eefe0 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:18.499416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 672/1364] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:18.504450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078b16-2db9-4ab6-80d2-6efbab2c056e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:18.504855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078b16-2db9-4ab6-80d2-6efbab2c056e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:18.505078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078b16-2db9-4ab6-80d2-6efbab2c056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:18.577185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-99078b16-2db9-4ab6-80d2-6efbab2c056e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:18.578455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-99078b16-2db9-4ab6-80d2-6efbab2c056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:18.679402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:18.694190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 693/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:18.972720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:18.973309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:18.973684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:18.976114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 673/1366] 10.222.0.42 () {54 vars in 962 bytes} [Fri Sep 9 13:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:18.981621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21095e-ec00-4676-9b26-8cd3199094a3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:18.981911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21095e-ec00-4676-9b26-8cd3199094a3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:18.982187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21095e-ec00-4676-9b26-8cd3199094a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:19.060620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6d21095e-ec00-4676-9b26-8cd3199094a3 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:19.061828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6d21095e-ec00-4676-9b26-8cd3199094a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:19.184294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 694/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Sep 9 13:17:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:19.192255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:19.193807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:19.348524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe45d-02bb-400c-a499-f4cee1bc4eae None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:19.369675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:19.473791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:19.475159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:19.475690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:19.476064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:19.477823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:19.576979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:19.578677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d309ed-e793-403e-87c2-0832d58a4758 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:19.605260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 674/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:19.755529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c065-6655-45df-80a3-701036b0369e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:19.756816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c065-6655-45df-80a3-701036b0369e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:19.757233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c065-6655-45df-80a3-701036b0369e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:19.758937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 695/1369] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:19.765122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c812-213e-40cc-a6e3-c0014f983417 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:19.766055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c812-213e-40cc-a6e3-c0014f983417 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:19.766585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c812-213e-40cc-a6e3-c0014f983417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:19.804777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:19.862129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2e13c812-213e-40cc-a6e3-c0014f983417 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:19.863776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2e13c812-213e-40cc-a6e3-c0014f983417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:19.971563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 675/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:20.311542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:20.311542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:20.311542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:20.314652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 696/1371] 10.222.0.42 () {54 vars in 964 bytes} [Fri Sep 9 13:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:20.317794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339bbae-fe36-4dce-935d-5de2dd1749ea None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:20.318701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339bbae-fe36-4dce-935d-5de2dd1749ea None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:20.319023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339bbae-fe36-4dce-935d-5de2dd1749ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:20.400710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5339bbae-fe36-4dce-935d-5de2dd1749ea None None] MFA Rules not processed for user `e975eec1e5ff4fda97d9a51abd6240bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:20.402112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5339bbae-fe36-4dce-935d-5de2dd1749ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:20.456027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.489449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 676/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Sep 9 13:17:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:20.497080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:20.498690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:20.552323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.614328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494fd07-e7b7-4adb-9166-389f8ba43800 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:20.706038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:20.707534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:20.708288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:20.709035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:20.712563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:20.858064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.876096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:20.879377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73cb12-ff75-4516-b016-4c7c248f882a service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:20.898738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 697/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:17:21.879717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:21.880242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:21.880416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:21.882339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 677/1374] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:21.887583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aac11-b13d-48ea-a79d-14e2c9817f4c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:21.888033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aac11-b13d-48ea-a79d-14e2c9817f4c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:21.888257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14aac11-b13d-48ea-a79d-14e2c9817f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:21.958357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e14aac11-b13d-48ea-a79d-14e2c9817f4c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:21.959651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e14aac11-b13d-48ea-a79d-14e2c9817f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:22.055708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 698/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:22.355909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:22.357475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:22.524830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cdd47-62b2-45d0-86ae-f583f3b4875b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:22.578596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:22.641570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:22.642282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:22.642559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:22.642826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:22.644400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:22.736101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:22.738176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb5a9-cb39-42ca-a720-ad352a40acf7 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:22.757675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 678/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:17:24.980717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:24.981261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:24.981261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:24.982809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 699/1377] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:24.987936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26ee4-6d24-439b-b5b0-7fda48f90166 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:24.988359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26ee4-6d24-439b-b5b0-7fda48f90166 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:24.988543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d26ee4-6d24-439b-b5b0-7fda48f90166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:25.057688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-66d26ee4-6d24-439b-b5b0-7fda48f90166 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:25.058922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-66d26ee4-6d24-439b-b5b0-7fda48f90166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:25.066416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:25.165552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 679/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:25.456178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:25.457720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:25.524355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:25.621173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6388b-defc-4e1c-9bbd-5db12cf7ec8f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:25.741926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:25.742560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:25.742835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:25.743103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:25.744681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:25.766032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:25.844885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:25.846644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023a93f-c8de-4360-b5a1-e7c372ff3157 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:25.866459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 700/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:28.101923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:28.102484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:28.102484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:28.104007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 680/1380] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:28.109219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649400-d052-44f5-bc4c-2e5a6f512f62 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:28.109635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649400-d052-44f5-bc4c-2e5a6f512f62 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:28.109806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649400-d052-44f5-bc4c-2e5a6f512f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:28.178085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2e649400-d052-44f5-bc4c-2e5a6f512f62 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:28.179387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2e649400-d052-44f5-bc4c-2e5a6f512f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:28.280286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:28.287591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 701/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:28.588866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:28.590436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:28.739858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:28.751276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ae594-703d-4279-918b-c634b14a4e11 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:28.894281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:28.894819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:28.895103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:28.895374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:28.897541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:29.006744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:29.008374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb46e2-a1e0-4b08-94b6-13cfef4ac029 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:29.018506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:29.027767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 681/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:32.278090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:32.278684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:32.279125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:32.281470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 702/1383] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:32.286802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacefdc-6205-4424-a777-1c7cd39629ba None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:32.288054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacefdc-6205-4424-a777-1c7cd39629ba None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:32.288054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacefdc-6205-4424-a777-1c7cd39629ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:32.359771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9dacefdc-6205-4424-a777-1c7cd39629ba None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:32.360982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9dacefdc-6205-4424-a777-1c7cd39629ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:32.471674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 682/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:32.776598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:32.778202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:32.936567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a03f32-599f-4511-be16-f7a4ab55ece7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:33.013619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:33.063829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:33.064583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:33.064887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:33.065178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:33.067164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:33.165998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:33.167647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25506aa-880a-4d9b-a3b8-cb36c47d9e83 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:33.187344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 703/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:35.512967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:35.513622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:35.513622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:35.515026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 683/1386] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:35.520031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd6e3-c5d0-4297-9fda-d36db907057d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:35.520458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd6e3-c5d0-4297-9fda-d36db907057d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:35.520562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfd6e3-c5d0-4297-9fda-d36db907057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:35.600623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a7bfd6e3-c5d0-4297-9fda-d36db907057d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:35.602201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a7bfd6e3-c5d0-4297-9fda-d36db907057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:35.639445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:35.717814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 704/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:36.008506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:36.010016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:36.089427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:36.162561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070baf51-8992-4d4f-a4e4-e950e3352c9a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:36.210114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a865c-441f-4f64-932e-3088614aae3d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:36.210446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a865c-441f-4f64-932e-3088614aae3d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:36.210723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a865c-441f-4f64-932e-3088614aae3d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:36.212110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 705/1388] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:17:36.217109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20a76e-08d0-477f-87ce-e6e32275b1ec None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:36.217393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20a76e-08d0-477f-87ce-e6e32275b1ec None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:36.217664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20a76e-08d0-477f-87ce-e6e32275b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:36.276766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:36.277393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:36.277672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:36.277947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:36.279596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:36.285626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5b20a76e-08d0-477f-87ce-e6e32275b1ec None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:36.286843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5b20a76e-08d0-477f-87ce-e6e32275b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:36.320520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:36.372776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:36.374320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c20dd6-130c-4cc2-b350-60516fa0f9b3 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:36.388345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 706/1389] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:17:36.392941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 684/1390] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:36.687692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:36.688219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:36.688392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:36.689929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 707/1391] 10.222.0.42 () {54 vars in 966 bytes} [Fri Sep 9 13:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:36.695861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1bb-6f89-4375-93a7-177180ae5692 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:36.696275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1bb-6f89-4375-93a7-177180ae5692 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:36.696531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1bb-6f89-4375-93a7-177180ae5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:36.773561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-be65d1bb-6f89-4375-93a7-177180ae5692 None None] MFA Rules not processed for user `55004b070d1e42968d2f8272071034bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:36.774802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-be65d1bb-6f89-4375-93a7-177180ae5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:36.857202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 685/1392] 10.222.0.42 () {58 vars in 1063 bytes} [Fri Sep 9 13:17:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:36.866540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:36.868148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:36.882251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:36.976418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b7412-fce7-478a-9dbc-b28b1ddf2859 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:37.058233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:37.058858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:37.059121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:37.059392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:37.061000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:37.132128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:37.175894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:37.177325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e80168-bb4c-49ad-8cee-cb065646cf7d service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:37.195921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 708/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:37.951086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2168cd-9fc9-4f9b-816c-4f2c042b0292 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:37.951587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2168cd-9fc9-4f9b-816c-4f2c042b0292 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:37.951670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2168cd-9fc9-4f9b-816c-4f2c042b0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:37.994104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:38.028818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9d2168cd-9fc9-4f9b-816c-4f2c042b0292 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:38.030024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9d2168cd-9fc9-4f9b-816c-4f2c042b0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:38.128088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 686/1394] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:17:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:38.182866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:38.183776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:38.184237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:38.185666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 709/1395] 10.222.0.42 () {54 vars in 943 bytes} [Fri Sep 9 13:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:38.193170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a102e8-b00f-4c19-b968-a48a8c85726a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:38.193923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a102e8-b00f-4c19-b968-a48a8c85726a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:38.194867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a102e8-b00f-4c19-b968-a48a8c85726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:38.273918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-57a102e8-b00f-4c19-b968-a48a8c85726a None None] MFA Rules not processed for user `a90385a931614a58ac3782a79b1a9457`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:38.275144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-57a102e8-b00f-4c19-b968-a48a8c85726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:38.331289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:38.387731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 687/1396] 10.222.0.42 () {58 vars in 1040 bytes} [Fri Sep 9 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:38.397350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:38.399029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:38.543629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454eb0-03a0-4f7a-a653-7718f0d132d7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:38.581921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:38.612119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19a63-c7c7-434b-abb3-fb30d0685ff7 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:38.612415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19a63-c7c7-434b-abb3-fb30d0685ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:38.612689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19a63-c7c7-434b-abb3-fb30d0685ff7 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:38.614692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 688/1397] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 13:17:38.620375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163415a-558d-472a-927e-2c0456fe3d55 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:38.620652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163415a-558d-472a-927e-2c0456fe3d55 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:38.620922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163415a-558d-472a-927e-2c0456fe3d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:38.651257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:38.651866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:38.652146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:38.652422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:38.654082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:38.688664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d163415a-558d-472a-927e-2c0456fe3d55 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:38.689876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d163415a-558d-472a-927e-2c0456fe3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:38.741924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:38.743576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:38.751920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 710/1398] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:17:38.793857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 689/1399] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:17:39.116216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:39.117629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:39.194529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:39.224415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44abae-abb8-4aed-9483-324e8bc96066 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:39.348918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:39.349443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:39.350408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:39.350694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:39.354545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:39.448577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:39.452741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:39.455270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadacf68-295c-4cd8-9aed-2238765f67f9 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:39.477346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 711/1400] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:41.824772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:41.825297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:41.825297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:41.830724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 690/1401] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:41.832333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4dea-7161-4834-901f-833b1bed7ff0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:41.835717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4dea-7161-4834-901f-833b1bed7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:41.835717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4dea-7161-4834-901f-833b1bed7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:41.907869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-52fd4dea-7161-4834-901f-833b1bed7ff0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:41.909362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-52fd4dea-7161-4834-901f-833b1bed7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:42.023927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 712/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:42.342503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:42.343946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:42.382242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:42.514951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11954bbd-bd4a-4821-9adf-abdf8516a86d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:42.629849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:42.641587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:42.642199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:42.642508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:42.642777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:42.644371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:42.748608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:42.750277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298ddf8-7b92-4979-93d2-2bb8f72def79 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:42.769515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 691/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:45.011246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:45.011772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:45.011772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:45.014316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 713/1404] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:45.020372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9631c-2ce4-48b4-a71a-332337be342e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:45.020372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9631c-2ce4-48b4-a71a-332337be342e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:45.020372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9631c-2ce4-48b4-a71a-332337be342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:45.098599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f7d9631c-2ce4-48b4-a71a-332337be342e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:45.099995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f7d9631c-2ce4-48b4-a71a-332337be342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:45.169166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:45.210515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 692/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:17:45.502519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:45.504049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:45.594468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:45.726918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509803fa-5532-4565-b453-8cfc2a52e899 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:45.862664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:45.863273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:45.863551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:45.863822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:45.866112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:45.895837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:45.967067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:45.969182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe85c0-5461-42fe-b9f0-da3f516f8cfa service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:45.988622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 714/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:48.206024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:48.206629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:48.206629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:48.207944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 693/1407] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:17:48.213755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643ec2-79a0-42a4-baea-7366cc149b68 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:48.214645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643ec2-79a0-42a4-baea-7366cc149b68 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:48.215103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df643ec2-79a0-42a4-baea-7366cc149b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:48.289442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-df643ec2-79a0-42a4-baea-7366cc149b68 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:17:48.290909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df643ec2-79a0-42a4-baea-7366cc149b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:48.402781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 715/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:17:48.691932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:17:48.693746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:48.860395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88d43f-2b02-4b56-8d22-b51968601616 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:17:48.913143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:48.991327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:17:48.992339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:17:48.992675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:17:48.993042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:17:48.994861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:17:49.103516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:17:49.105158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb187d42-9c75-41e9-b6a0-aa5af455f25a service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:17:49.128941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 694/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:17:58.398890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:59.126485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=76 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:01.507919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173c0f-8488-4699-8de9-11ab6c8e467b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:01.508566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173c0f-8488-4699-8de9-11ab6c8e467b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:01.508566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9173c0f-8488-4699-8de9-11ab6c8e467b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:01.509810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 716/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Sep 9 13:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:01.515009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a31c1-41da-4b34-adc5-f4fe0956d139 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:01.515418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a31c1-41da-4b34-adc5-f4fe0956d139 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:01.515558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a31c1-41da-4b34-adc5-f4fe0956d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:01.592793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-228a31c1-41da-4b34-adc5-f4fe0956d139 None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:01.594003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-228a31c1-41da-4b34-adc5-f4fe0956d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:01.698226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 695/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Sep 9 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:01.712487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b6648-65f3-4049-887f-21b758d9d910 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:01.712779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b6648-65f3-4049-887f-21b758d9d910 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:01.713052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b6648-65f3-4049-887f-21b758d9d910 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:01.714419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 717/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Sep 9 13:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:01.719001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7a89-be5d-41b6-9cb0-725a3fe06e9a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:01.719285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7a89-be5d-41b6-9cb0-725a3fe06e9a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:01.719560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7a89-be5d-41b6-9cb0-725a3fe06e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:01.792984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:01.795880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-edfd7a89-be5d-41b6-9cb0-725a3fe06e9a None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:01.797707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-edfd7a89-be5d-41b6-9cb0-725a3fe06e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:01.914622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 696/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Sep 9 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:04.503061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:04.503606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:04.503718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:04.505021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:04.511091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f2e6-14af-4fcb-bcda-ff19f889fe3e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:04.511502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f2e6-14af-4fcb-bcda-ff19f889fe3e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:04.511637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211f2e6-14af-4fcb-bcda-ff19f889fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:04.579448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7211f2e6-14af-4fcb-bcda-ff19f889fe3e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:04.580674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7211f2e6-14af-4fcb-bcda-ff19f889fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:04.636800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:04.798830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:05.087898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:05.089517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:05.237672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a185a-f488-4083-b3de-be05d0965741 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:05.309864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:05.350878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82905139-4351-4da7-a605-5df152571de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:05.351408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905139-4351-4da7-a605-5df152571de5 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:05.351683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905139-4351-4da7-a605-5df152571de5 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:05.351952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82905139-4351-4da7-a605-5df152571de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:05.353555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-82905139-4351-4da7-a605-5df152571de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:05.441261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82905139-4351-4da7-a605-5df152571de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:05.442878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82905139-4351-4da7-a605-5df152571de5 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:05.461467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 719/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:06.601704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:06.602465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:06.602465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:06.603587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:06.609898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3bb0-48ba-4011-9241-7007fc33812f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:06.610379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3bb0-48ba-4011-9241-7007fc33812f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:06.610485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3bb0-48ba-4011-9241-7007fc33812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:06.685409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bb5d3bb0-48ba-4011-9241-7007fc33812f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:06.686634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bb5d3bb0-48ba-4011-9241-7007fc33812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:06.712654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:06.781051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:06.931494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:06.932905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:07.078710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dbf22-9342-42f5-8437-b49fb828a430 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:07.119775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:07.191356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:07.191874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:07.192155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:07.192426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:07.194291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:07.287186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:07.289030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677485-ee7a-4ab1-9598-ac47784df5ef service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:07.306926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 699/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:08.440363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:08.440941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:08.440941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:08.442233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:08.448653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a3e4-3e0f-4d2b-9cda-e103dc0d9fc0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:08.449097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a3e4-3e0f-4d2b-9cda-e103dc0d9fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:08.449213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975a3e4-3e0f-4d2b-9cda-e103dc0d9fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:08.502821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:08.526511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0975a3e4-3e0f-4d2b-9cda-e103dc0d9fc0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:08.531931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0975a3e4-3e0f-4d2b-9cda-e103dc0d9fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:08.639644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:08.791524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:08.793047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:08.940706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cb30-8a63-4cea-8a49-d8fd727238cc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:08.953315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:09.051682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:09.052209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:09.052486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:09.052759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:09.054458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:09.145009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:09.146656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348b5a-45f6-4219-a459-bbd07238e985 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:09.165844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 722/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:10.275456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:10.276019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:10.276019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:10.277336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:10.283514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32efd3-589f-4511-9fb8-98a7395735bc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:10.283933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32efd3-589f-4511-9fb8-98a7395735bc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:10.284073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32efd3-589f-4511-9fb8-98a7395735bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:10.304372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:10.361449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff32efd3-589f-4511-9fb8-98a7395735bc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:10.362626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff32efd3-589f-4511-9fb8-98a7395735bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:10.460071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:10.613704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:10.615149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:10.721231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:10.757392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f6d2-c865-4e76-ada9-33c7c839147f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:10.870481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:10.871016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:10.871297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:10.871567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:10.873156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:10.948645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:10.962645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:10.964215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0299ae-c6d7-4dd3-b631-fd4ffde14f78 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:10.982623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 702/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:12.118440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:12.118865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:12.119002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:12.120359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:12.126552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4975-9405-4dbf-8ba2-7b9f4ab41ea8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:12.127025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4975-9405-4dbf-8ba2-7b9f4ab41ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:12.127125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4975-9405-4dbf-8ba2-7b9f4ab41ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:12.203266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b8ee4975-9405-4dbf-8ba2-7b9f4ab41ea8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:12.204456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b8ee4975-9405-4dbf-8ba2-7b9f4ab41ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:12.299144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:12.450950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:12.452447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:12.535830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:12.598567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5fc7b-8688-4e59-b9c3-3f12aa8a50b6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:12.710873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:12.711404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:12.711683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:12.711954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:12.713546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:12.762024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:12.802981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:12.805344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a332-34ac-422f-a1c0-2700ac046346 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:12.823530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 725/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:13.883832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:13.884366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:13.884366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:13.885728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:13.892142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112e60-8b23-453e-a02b-3122c8e238fb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:13.892563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112e60-8b23-453e-a02b-3122c8e238fb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:13.892690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be112e60-8b23-453e-a02b-3122c8e238fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:13.967997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-be112e60-8b23-453e-a02b-3122c8e238fb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:13.969199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-be112e60-8b23-453e-a02b-3122c8e238fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:14.065676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:14.216593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:14.218087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:14.269531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:14.368744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebe06b-591b-4f2c-b018-6186086b2247 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:14.482486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:14.483094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:14.483368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:14.483640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:14.485224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:14.492582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:14.580584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:14.582235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88cb4f-d7a0-4d98-99b1-af88651a3a94 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:14.600358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 705/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:15.650030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:15.650633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:15.650633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:15.651959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:15.658067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa968-69ec-4b70-9835-3da302924c31 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:15.658523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa968-69ec-4b70-9835-3da302924c31 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:15.658644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fa968-69ec-4b70-9835-3da302924c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:15.734858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-406fa968-69ec-4b70-9835-3da302924c31 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:15.736317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-406fa968-69ec-4b70-9835-3da302924c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:15.801738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:15.831333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:18:15.981837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:15.983372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:16.001663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:16.129913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ad849-3470-4f7b-b459-05394028e8ea None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:16.219468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:16.245196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:16.245738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:16.246019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:16.246319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:16.247920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:16.336907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:16.338563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32074b5e-d9c4-4681-9c85-e2dc60d1d5d9 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:16.356711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 728/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:17.415706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec579-48c2-4fba-9208-72532716df87 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:17.416281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec579-48c2-4fba-9208-72532716df87 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:17.416281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec579-48c2-4fba-9208-72532716df87 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:17.417652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:17.424096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015c5a-a9f0-4ac6-bd22-c62e8901be9d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:17.424545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015c5a-a9f0-4ac6-bd22-c62e8901be9d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:17.424639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015c5a-a9f0-4ac6-bd22-c62e8901be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:17.501922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d1015c5a-a9f0-4ac6-bd22-c62e8901be9d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:17.503173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d1015c5a-a9f0-4ac6-bd22-c62e8901be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:17.663948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:17.719860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:17.870061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec579-48c2-4fba-9208-72532716df87 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:17.871686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-690ec579-48c2-4fba-9208-72532716df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:18.019086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec579-48c2-4fba-9208-72532716df87 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:18.074384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:18.134042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:18.134671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:18.134951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:18.135220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:18.136803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:18.227160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:18.228744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ab5f-3675-41d9-a76d-d5882e93bc57 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:18.246675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 708/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:19.286339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:19.287109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:19.287109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:19.288224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:19.295259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777828-820f-41a8-83de-cf2d71e73c34 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:19.295692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777828-820f-41a8-83de-cf2d71e73c34 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:19.295807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68777828-820f-41a8-83de-cf2d71e73c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:19.372473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-68777828-820f-41a8-83de-cf2d71e73c34 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:19.373667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-68777828-820f-41a8-83de-cf2d71e73c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:19.375886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:19.470293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:19.623926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:19.625355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:19.771727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d21a2a-cddf-41f2-afd3-696733082601 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:19.798857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:19.883840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:19.884370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:19.884646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:19.884915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:19.886537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:19.974926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:19.976956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7820238-8ecf-44e1-a15a-65ca2e027a1b service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:19.995038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 731/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:22.093050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:22.093595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:22.093595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:22.094885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:22.100227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ebf0-cc89-4ec8-aee0-07e798954a22 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:22.100621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ebf0-cc89-4ec8-aee0-07e798954a22 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:22.101481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80ebf0-cc89-4ec8-aee0-07e798954a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:22.142454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:22.168459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7e80ebf0-cc89-4ec8-aee0-07e798954a22 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:22.169655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e80ebf0-cc89-4ec8-aee0-07e798954a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:22.263368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:22.549594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:22.551182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:22.653778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc253e85-db37-4028-98f5-1129ee5f2989 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:22.686541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:22.728395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:22.728997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:22.729277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:22.729548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:22.731184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:22.840013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:22.841456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf26015-c58b-4d6b-a4bf-1deafd3bf730 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:22.860284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 711/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:25.142242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:25.142786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:25.142786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:25.144023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:25.149796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455733-44df-4a91-ba87-daa0ba02401f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:25.150227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455733-44df-4a91-ba87-daa0ba02401f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:25.150371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25455733-44df-4a91-ba87-daa0ba02401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:25.214047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-25455733-44df-4a91-ba87-daa0ba02401f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:25.215253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-25455733-44df-4a91-ba87-daa0ba02401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:25.228469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:25.312433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:18:25.596112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:25.597632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:25.699641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee9fc2-05c9-4e69-8ee9-874c11e33c83 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:25.712763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:25.772477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:25.773854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:25.774130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:25.774430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:25.776010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:25.885882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:25.887289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327d495-fb28-4e6d-8c17-fee6b87f3129 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:25.905134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 734/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:28.431065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:28.431618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:28.431618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:28.432858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:28.438133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86bd6-5daf-4491-a16d-faad9031e5ad None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:28.438565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86bd6-5daf-4491-a16d-faad9031e5ad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:28.438717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a86bd6-5daf-4491-a16d-faad9031e5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:28.487791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:28.505843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-58a86bd6-5daf-4491-a16d-faad9031e5ad None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:28.507077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-58a86bd6-5daf-4491-a16d-faad9031e5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:28.600445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:28.889159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:28.890721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:28.993359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99095359-39f7-4338-b2c5-a60b58d46343 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:29.033601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:29.067701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:29.068303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:29.068582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:29.068855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:29.070850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:29.178558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:29.180518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709ca16-6c0f-46b4-a05a-7911b22fd785 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:29.198612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 714/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:31.454294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:31.454837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:31.454837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:31.456211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:31.461697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1530-9822-4df5-999c-15c1c4442c20 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:31.462152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1530-9822-4df5-999c-15c1c4442c20 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:31.462279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1530-9822-4df5-999c-15c1c4442c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:31.526857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-eb4c1530-9822-4df5-999c-15c1c4442c20 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:31.528050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-eb4c1530-9822-4df5-999c-15c1c4442c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:31.548341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:31.623310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:31.907873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:31.909380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:32.013294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c201-35ce-4fd2-b823-8a55fc8aa256 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:32.035265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:32.091128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:32.091661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:32.091939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:32.092211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:32.093800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:32.202241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:32.203703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece767a-e892-4056-b6b4-71ad4b873614 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:32.221727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 737/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:34.552851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:34.553385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:34.553385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:34.555381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:34.560778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2015f-8b2a-4e53-83eb-5903efcddf88 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:34.561243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2015f-8b2a-4e53-83eb-5903efcddf88 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:34.561348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2015f-8b2a-4e53-83eb-5903efcddf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:34.624663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:34.627791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-14b2015f-8b2a-4e53-83eb-5903efcddf88 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:34.629566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-14b2015f-8b2a-4e53-83eb-5903efcddf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:34.728229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:35.019671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:35.021199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:35.123013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b7fc-c9ff-41b1-bb98-fc8120ae5522 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:35.172188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:35.196533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:35.197119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:35.197392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:35.197657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:35.199257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:35.306395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:35.307832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ae27c-4e4c-47c3-a62c-77971e16a9e7 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:35.326885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 717/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:37.547035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:37.547697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:37.547697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:37.548919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:37.554884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcbc3-e634-49f0-8e1e-692021eb5b44 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:37.555838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcbc3-e634-49f0-8e1e-692021eb5b44 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:37.556120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbcbc3-e634-49f0-8e1e-692021eb5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:37.623575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4ddbcbc3-e634-49f0-8e1e-692021eb5b44 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:37.624794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4ddbcbc3-e634-49f0-8e1e-692021eb5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:37.653560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:37.720590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:38.007953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:38.009508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:38.117963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3ac6-2be9-419e-ab9a-5150f291544a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:38.146463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:38.192487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:38.193090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:38.193367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:38.193639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:38.196187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:38.309949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:38.311428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eaeab-1407-4791-8455-8b2cc46b2fab service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:38.334240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 740/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:40.531393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:40.531975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:40.531975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:40.533296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:40.539391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8da5-aedc-4998-acad-f5639f3cf53d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:40.539900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8da5-aedc-4998-acad-f5639f3cf53d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:40.540255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8da5-aedc-4998-acad-f5639f3cf53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:40.606416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6ad8da5-aedc-4998-acad-f5639f3cf53d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:40.607641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6ad8da5-aedc-4998-acad-f5639f3cf53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:40.615839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:40.703805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:40.988875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:40.990454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:41.095328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edcb98-d9ac-445f-9e3e-880ce0f6c804 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:41.152482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:41.171150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:41.171760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:41.172042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:41.172310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:41.173899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:41.282934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:41.284389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38af97a-0ecc-4030-8dce-ccbb08226db5 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:41.302105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 720/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:43.501885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:43.502480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:43.502583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:43.504036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:43.509818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e9e3-0f6b-4c27-8acd-91e517d105d6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:43.510294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e9e3-0f6b-4c27-8acd-91e517d105d6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:43.510394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e9e3-0f6b-4c27-8acd-91e517d105d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:43.576319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fd87e9e3-0f6b-4c27-8acd-91e517d105d6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:43.577536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fd87e9e3-0f6b-4c27-8acd-91e517d105d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:43.615724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:43.675044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:43.955471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:43.957044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:44.064809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fd72f-863f-41b8-90d6-e30db2c913e5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:44.102950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:44.139373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:44.139978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:44.140252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:44.140520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:44.142277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:44.248562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:44.249983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb94a23-1a93-4593-9aee-864b1e6f8c9a service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:44.267427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 743/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:46.459116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:46.459671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:46.459671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:46.461526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:46.467642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a25e-fe8e-4b0d-93ad-3a223c8b72a1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:46.468074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a25e-fe8e-4b0d-93ad-3a223c8b72a1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:46.468193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a25e-fe8e-4b0d-93ad-3a223c8b72a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:46.533741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6e4a25e-fe8e-4b0d-93ad-3a223c8b72a1 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:46.534969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6e4a25e-fe8e-4b0d-93ad-3a223c8b72a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:46.552610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:46.630410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:46.912690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:46.914283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:47.016192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90758bab-cee0-4d96-b1fd-e53abd511a0c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:47.081425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:47.088869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:47.089475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:47.089757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:47.090021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:47.091638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:47.200293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:47.201722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419a622-ccc8-40fb-80af-162472e608e1 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:47.219519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 723/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:49.389512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:49.390085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:49.390085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:49.391422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:18:49.396880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be561-2ed6-4ff8-91bc-ed8a341de8f2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:49.397572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be561-2ed6-4ff8-91bc-ed8a341de8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:49.397572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be561-2ed6-4ff8-91bc-ed8a341de8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:49.463509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9b4be561-2ed6-4ff8-91bc-ed8a341de8f2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:18:49.464706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9b4be561-2ed6-4ff8-91bc-ed8a341de8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:49.512944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:49.561881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:18:49.849173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:18:49.850748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:49.952706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756af78-5e5a-48b2-964a-da1e0ea505c7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:18:49.999754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:50.025475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:18:50.026072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:18:50.026375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:18:50.026642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:18:50.028235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:18:50.137108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:18:50.138578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac91949-8e88-45c3-be1f-6263410a9919 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:18:50.156566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 746/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:18:59.560381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=22 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:00.154354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=66 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:10.237542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e481f-2279-415e-b66e-029ea6c79ef8 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:10.238126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e481f-2279-415e-b66e-029ea6c79ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:10.238126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e481f-2279-415e-b66e-029ea6c79ef8 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:10.239493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 725/1471] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:10.244904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34de4-f0b5-49c7-a55e-dac2c651d941 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:10.245364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34de4-f0b5-49c7-a55e-dac2c651d941 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:10.245472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34de4-f0b5-49c7-a55e-dac2c651d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:10.311250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c3c34de4-f0b5-49c7-a55e-dac2c651d941 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:10.312453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c3c34de4-f0b5-49c7-a55e-dac2c651d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:10.410932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 747/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:10.719428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:10.719712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:10.719985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:10.721315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 726/1473] 10.222.0.42 () {54 vars in 966 bytes} [Fri Sep 9 13:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:10.726344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdc20-e358-42eb-988c-1e400e00d674 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:10.726669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdc20-e358-42eb-988c-1e400e00d674 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:10.727005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbdc20-e358-42eb-988c-1e400e00d674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:10.803054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e2cbdc20-e358-42eb-988c-1e400e00d674 None None] MFA Rules not processed for user `55004b070d1e42968d2f8272071034bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:10.804264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e2cbdc20-e358-42eb-988c-1e400e00d674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:10.825923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:10.882221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 748/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Fri Sep 9 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:10.890648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:10.892127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:10.992795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f241e6-ebc1-4b32-ba0e-16bd4ffa07a3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:11.065517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:11.066115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:11.066418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:11.066688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:11.068255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:11.123385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:11.178907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:11.180356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f2991-ab37-4793-9c5b-41838de22950 service glance] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:11.200132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 727/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:13.427788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:13.428419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:13.428419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:13.429664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 749/1476] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:13.435526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108359-90ba-4aa0-8b52-649800343ca8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:13.435980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108359-90ba-4aa0-8b52-649800343ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:13.436122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba108359-90ba-4aa0-8b52-649800343ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:13.501249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ba108359-90ba-4aa0-8b52-649800343ca8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:13.502502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ba108359-90ba-4aa0-8b52-649800343ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:13.598836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 728/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:19:13.872038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:13.873500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:13.995928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823666a-9636-4dc2-a080-8436b8c4b29a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:14.043746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:14.088918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:14.089510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:14.089789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:14.090058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:14.090723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:14.092452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:19:14.092452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:19:14.092452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:19:14.093586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a8b2-db95-468e-a913-af568d1a80c9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:14.112903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 750/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Sep 9 13:19:13 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:19:16.289041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:16.289570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:16.289570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:16.291292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 729/1479] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:16.296710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8627-430f-4667-93cf-aee7acf70812 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:16.297148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8627-430f-4667-93cf-aee7acf70812 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:16.297256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8627-430f-4667-93cf-aee7acf70812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:16.362679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-667c8627-430f-4667-93cf-aee7acf70812 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:16.363885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-667c8627-430f-4667-93cf-aee7acf70812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:16.459688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 751/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:16.757241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:16.758831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:16.768715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:16.905609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1bada-f483-4071-bcf7-d28b507563ec None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:16.984150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:17.016762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:17.017295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:17.017573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:17.017844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:17.019468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:17.107840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:17.109412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1634930-7f56-4517-aec4-716a68f7b765 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:17.126867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 730/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:19.457020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:19.457582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:19.457582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:19.458974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 752/1482] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:19.464392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e8ab8-4efd-41d3-bfad-62015f6c015d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:19.464803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e8ab8-4efd-41d3-bfad-62015f6c015d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:19.464963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e8ab8-4efd-41d3-bfad-62015f6c015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:19.529664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-873e8ab8-4efd-41d3-bfad-62015f6c015d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:19.530901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-873e8ab8-4efd-41d3-bfad-62015f6c015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:19.578016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:19.628820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 731/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:19.921749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:19.923327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:19.948687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:20.028926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7921b3-c364-434e-8720-97a0b6900c39 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:20.104103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:20.104809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:20.105147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:20.105545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:20.107164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:20.180828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:20.216572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:20.217995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2ffa5-16ee-4a1a-a1f7-53eb301a80d5 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:20.236109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 753/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:22.446658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:22.447476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:22.447476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:22.448762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 732/1485] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:22.454331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed4c3-a358-405a-9df4-66480cff1c47 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:22.454740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed4c3-a358-405a-9df4-66480cff1c47 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:22.454883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed4c3-a358-405a-9df4-66480cff1c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:22.520199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c94ed4c3-a358-405a-9df4-66480cff1c47 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:22.521405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c94ed4c3-a358-405a-9df4-66480cff1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:22.617813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 754/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:22.907144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:22.908675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:23.011446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bd39e-e17e-4f35-8f44-275f1ea1a991 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:23.081818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:23.083217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:23.083864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:23.084329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:23.084762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:23.086549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:23.195061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:23.196481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f337392-fd72-4dfb-923f-21115fd573be service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:23.214887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 733/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:25.492331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:25.492901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:25.492901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:25.494778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 755/1488] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:25.500309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd274d9-aa41-42a0-b05e-ee083edd0672 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:25.500755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd274d9-aa41-42a0-b05e-ee083edd0672 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:25.500864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd274d9-aa41-42a0-b05e-ee083edd0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:25.567087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6cd274d9-aa41-42a0-b05e-ee083edd0672 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:25.568299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6cd274d9-aa41-42a0-b05e-ee083edd0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:25.620784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:25.665538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 734/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:25.961494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:25.963160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:25.999873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:26.067589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3e34e-a939-440e-a57b-462fce2f400c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:26.140944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:26.141468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:26.141746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:26.142019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:26.143820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:26.224155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:26.253446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:26.254921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603a8b8-0280-42a7-8abf-0bec0adae1b7 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:26.272304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 756/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:28.687078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:28.687639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:28.687639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:28.688949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 735/1491] 10.222.0.42 () {54 vars in 927 bytes} [Fri Sep 9 13:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:19:28.694105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a49b-5f97-46e9-a330-ba1644352aeb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:28.694577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a49b-5f97-46e9-a330-ba1644352aeb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:28.694730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a49b-5f97-46e9-a330-ba1644352aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:28.759942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e368a49b-5f97-46e9-a330-ba1644352aeb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:19:28.761275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e368a49b-5f97-46e9-a330-ba1644352aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:28.858297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 757/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Fri Sep 9 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:19:29.149760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:19:29.152123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:29.253498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fd9f1-9b3d-42d4-beb7-d20cd083549d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:19:29.326222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:19:29.326848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:19:29.327127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:19:29.327398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:19:29.328991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:19:29.338390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:29.437312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:19:29.438704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe663dd-a16f-4190-b97d-3707335fbc60 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:19:29.457155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 736/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:19:38.856786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=82 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:39.455012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=50 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:41.941998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:41.942574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:41.942574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.021622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:20:42.022877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.120926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 758/1494] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:20:42.128712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:42.129211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:42.129326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.204332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:20:42.205386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.301350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 737/1495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:20:42.305930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:42.307203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.318477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d44f2c-3e04-44a7-b8b6-6d75766c8b90 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:42.378759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:42.413421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:42.414021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:42.414406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:42.414677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.415317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:20:42.415615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:42.416673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:42.416673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:20:42.416673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:20:42.417505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:42.428500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 759/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:20:42.436982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:42.445990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac494c-a831-47ec-8ecc-d144c4e0e57c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:42.507328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:42.542826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:42.543429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:42.543799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:42.544074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.544703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:42.546450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:42.546450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:20:42.546450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:20:42.547640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:42.603685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 738/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:20:42 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:20:42.608446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:42.609981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.643988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90447-ea85-471b-86e6-bf096bcd09e0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:42.737659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:42.738284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:42.738560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:42.738829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.739448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:42.740439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:42.740439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:20:42.740439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:20:42.741638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:42.785172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 760/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:20:42 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:20:42.789331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:42.790854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.852617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37f05e-f0f9-4d27-b666-fd0851a9fa64 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:42.940071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:42.952151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:42.952755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:42.953032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:42.953298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:42.953927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:42.954959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:42.954959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:20:42.954959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:20:42.955844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:42.968739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 739/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:20:42.972819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:42.974362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:42.986178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017b3be-79b3-4d46-9d94-63120017a0a9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:43.012596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.083439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:43.084029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.084303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.084571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.085201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:43.086202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:43.086202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:20:43.086202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:20:43.087100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d64e92-143c-45ed-b012-e6c35931450f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:43.101578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 761/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:20:43.106327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:43.107881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:43.142234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370858-3838-42c5-ba64-03cf88009f41 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:43.235180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:43.235835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.236114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.236411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] PATH_INFO: `/v3/projects/dcb981c217de4a3eb35b5cf2e38cd62f/users/eb949b84a4d24ca6a3f82fd35b1f1394/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.259621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb981c217de4a3eb35b5cf2e38cd62f, user_id=eb949b84a4d24ca6a3f82fd35b1f1394, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:43.260716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:43.260716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:20:43.260716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:20:43.262739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91804b1-c76d-4653-a96e-9be826c40d1a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:43.286759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 740/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:20:43 2022] PUT /identity/v3/projects/dcb981c217de4a3eb35b5cf2e38cd62f/users/eb949b84a4d24ca6a3f82fd35b1f1394/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:20:43.299832 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464ea6-987f-45ef-849b-3b3bf97abe4a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.300114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464ea6-987f-45ef-849b-3b3bf97abe4a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.300384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464ea6-987f-45ef-849b-3b3bf97abe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.363411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-08464ea6-987f-45ef-849b-3b3bf97abe4a None None] MFA Rules not processed for user `eb949b84a4d24ca6a3f82fd35b1f1394`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:20:43.364615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-08464ea6-987f-45ef-849b-3b3bf97abe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:43.441361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 762/1502] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:20:43.455015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.455298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.455570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.456938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 741/1503] 10.222.0.42 () {54 vars in 964 bytes} [Fri Sep 9 13:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:20:43.461756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d16f-091c-4c90-a1f9-b4d9afb1e6bf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.462039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d16f-091c-4c90-a1f9-b4d9afb1e6bf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.462345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d16f-091c-4c90-a1f9-b4d9afb1e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.493906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.539007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7318d16f-091c-4c90-a1f9-b4d9afb1e6bf None None] MFA Rules not processed for user `e975eec1e5ff4fda97d9a51abd6240bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:20:43.540226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7318d16f-091c-4c90-a1f9-b4d9afb1e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:43.615971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 763/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Sep 9 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:20:43.624034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:43.625583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:43.676487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.732471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463434-e073-4b54-be30-7ba96b6a6aac None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:43.804929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:43.805466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.805741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.806010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.807657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:43.908694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:43.910127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:43.913562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.928877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 742/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:20:43.974013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3501c9-4f7c-470a-ba96-cea0c2c7a055 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:43.974445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3501c9-4f7c-470a-ba96-cea0c2c7a055 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:43.974597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3501c9-4f7c-470a-ba96-cea0c2c7a055 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:43.975853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 764/1506] 10.222.0.42 () {52 vars in 830 bytes} [Fri Sep 9 13:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:20:43.979879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:43.981071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:44.080247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b3b6-4702-49b9-8514-bb89d3c9b8f5 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:44.175156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:44.175856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:44.176043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:44.176310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] PATH_INFO: `/v3/users/eb949b84a4d24ca6a3f82fd35b1f1394` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:44.189915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb949b84a4d24ca6a3f82fd35b1f1394)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:44.191311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:44.191311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:20:44.191311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:20:44.192174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:44.203434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:44.259053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb949b84a4d24ca6a3f82fd35b1f1394'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:44.259584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb949b84a4d24ca6a3f82fd35b1f1394'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:44.260004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb949b84a4d24ca6a3f82fd35b1f1394'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:44.274474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb949b84a4d24ca6a3f82fd35b1f1394'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:44.297708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb949b84a4d24ca6a3f82fd35b1f1394'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:44.312257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 743/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:20:43 2022] DELETE /identity/v3/users/eb949b84a4d24ca6a3f82fd35b1f1394 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:20:44.316769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:44.317049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:44.317347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:44.373536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:20:44.374688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:44.451323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:44.464825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 765/1508] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:20:44.475090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:44.476302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:44.578971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa3a88-95ed-485e-80c9-8655f1ce7c70 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:44.634679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:44.655808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:44.656416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:44.656691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:44.656956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:44.658559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:44.766396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:44.767827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c866c2-214f-4a2f-a1e2-eed52764977b service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:44.785405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 744/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:20:45.129483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:20:45.130754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:20:45.142059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c6a3-e5eb-4e75-a841-d71929151954 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:20:45.240399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:20:45.241030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:20:45.241308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:20:45.241584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] PATH_INFO: `/v3/projects/dcb981c217de4a3eb35b5cf2e38cd62f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:20:45.251402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb981c217de4a3eb35b5cf2e38cd62f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:20:45.252421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:20:45.252421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:20:45.252421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:20:45.253610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:20:45.313348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb981c217de4a3eb35b5cf2e38cd62f', 'request_id': 'req-8cf15382-1d56-4fe2-9a40-161e8b974dd6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:45.327246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb981c217de4a3eb35b5cf2e38cd62f', 'request_id': 'req-8cf15382-1d56-4fe2-9a40-161e8b974dd6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:45.333215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb981c217de4a3eb35b5cf2e38cd62f', 'request_id': 'req-8cf15382-1d56-4fe2-9a40-161e8b974dd6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:45.360929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] The token cache is being invalidate because project dcb981c217de4a3eb35b5cf2e38cd62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:20:45.361308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:45.361824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cf15382-1d56-4fe2-9a40-161e8b974dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:20:45.363151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 766/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:20:45 2022] DELETE /identity/v3/projects/dcb981c217de4a3eb35b5cf2e38cd62f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:20:54.783192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=62 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:55.358944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:19.880715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:19.881253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:19.881253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:19.882685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:19.887539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2d30-b095-4d72-8cf3-026363ccdfba None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:19.887996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2d30-b095-4d72-8cf3-026363ccdfba None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:19.888094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2d30-b095-4d72-8cf3-026363ccdfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:19.968215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5a2e2d30-b095-4d72-8cf3-026363ccdfba None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:19.969434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5a2e2d30-b095-4d72-8cf3-026363ccdfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:20.071400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:20.227754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:20.229853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:20.351072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355785da-c17d-4a0e-b8d8-b46f4eb8875b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:20.356572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:20.357175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:20.357459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:20.357736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:20.366322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:20.367905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fdbee-e461-49c6-bcbd-d1969d4ce712 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:20.377138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 746/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:21.249455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443fd4-61d9-478e-bb38-269f603115eb None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:21.250009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443fd4-61d9-478e-bb38-269f603115eb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:21.250192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f443fd4-61d9-478e-bb38-269f603115eb None None] PATH_INFO: `/v3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:21.251896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 768/1514] 10.222.0.18 () {54 vars in 925 bytes} [Fri Sep 9 13:22:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:22:21.257927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d94e-6c23-4439-a4e0-41e5aee271a0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:21.258380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d94e-6c23-4439-a4e0-41e5aee271a0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:21.258514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d94e-6c23-4439-a4e0-41e5aee271a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:21.318742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5d00d94e-6c23-4439-a4e0-41e5aee271a0 None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:21.319950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5d00d94e-6c23-4439-a4e0-41e5aee271a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:21.388291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:21.394971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 747/1515] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:21.480229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990e1e-0868-45f4-9874-d652516494db None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:21.480507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990e1e-0868-45f4-9874-d652516494db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:21.480781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60990e1e-0868-45f4-9874-d652516494db None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:21.482122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:21.488067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb349-a145-43cf-9756-59bdc65dd38a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:21.488426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb349-a145-43cf-9756-59bdc65dd38a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:21.488707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb349-a145-43cf-9756-59bdc65dd38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:21.509345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-219fb349-a145-43cf-9756-59bdc65dd38a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:21.510503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-219fb349-a145-43cf-9756-59bdc65dd38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:21.518174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:21.671153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60990e1e-0868-45f4-9874-d652516494db None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:21.685298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60990e1e-0868-45f4-9874-d652516494db None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:21.690709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:21.691803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:21.692301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:21.692437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:21.700311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:21.701876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669688f-10f4-4ec1-a8e2-797a88bfe8f8 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:21.711953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 770/1518] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:31.503529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:31.707332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=75 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:31.814253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244b5a6-4ab7-4ee0-bca7-0e2f6d14ecb8 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:31.814621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244b5a6-4ab7-4ee0-bca7-0e2f6d14ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:31.814966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244b5a6-4ab7-4ee0-bca7-0e2f6d14ecb8 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:31.816380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 749/1519] 10.222.0.42 () {54 vars in 961 bytes} [Fri Sep 9 13:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:31.822572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a333d6-44cf-4a04-b198-8590ce0e212c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:31.822854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a333d6-44cf-4a04-b198-8590ce0e212c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:31.823124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a333d6-44cf-4a04-b198-8590ce0e212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:31.843560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-28a333d6-44cf-4a04-b198-8590ce0e212c None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:31.844752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-28a333d6-44cf-4a04-b198-8590ce0e212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:31.853978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 771/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Sep 9 13:22:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:31.861542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244b5a6-4ab7-4ee0-bca7-0e2f6d14ecb8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:31.875408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244b5a6-4ab7-4ee0-bca7-0e2f6d14ecb8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:31.880989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:31.881573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:31.881851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:31.882124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:31.890258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:31.891843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c709b-6efb-4843-b04d-42dabc3d641b service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:31.901811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 750/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:33.193697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb237-3cd7-453d-a5da-1777fcf24589 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:33.194239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb237-3cd7-453d-a5da-1777fcf24589 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:33.194239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeb237-3cd7-453d-a5da-1777fcf24589 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:33.195577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:33.201648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5af3-6e7d-44cf-85f9-91636db0cca2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:33.202109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5af3-6e7d-44cf-85f9-91636db0cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:33.202203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5af3-6e7d-44cf-85f9-91636db0cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:33.222123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a9bc5af3-6e7d-44cf-85f9-91636db0cca2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:33.223926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a9bc5af3-6e7d-44cf-85f9-91636db0cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:33.231747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:33.387080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb237-3cd7-453d-a5da-1777fcf24589 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:33.401331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeb237-3cd7-453d-a5da-1777fcf24589 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:33.406688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:33.407280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:33.407554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:33.407821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:33.416098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:33.417663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd5f7-cc7a-4c95-b12d-b2875f53dc4e service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:33.427638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 773/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:34.492951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9436-e75a-4dd4-b688-8e21301f03e3 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:34.493525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9436-e75a-4dd4-b688-8e21301f03e3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:34.493525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e9436-e75a-4dd4-b688-8e21301f03e3 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:34.494916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 13:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:34.501112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e71d5-0f18-417a-9d65-6fe42cc0874e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:34.501555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e71d5-0f18-417a-9d65-6fe42cc0874e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:34.501668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e71d5-0f18-417a-9d65-6fe42cc0874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:34.521348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4a2e71d5-0f18-417a-9d65-6fe42cc0874e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:34.522499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4a2e71d5-0f18-417a-9d65-6fe42cc0874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:34.530307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 13:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:34.682973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e9436-e75a-4dd4-b688-8e21301f03e3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:34.698409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e9436-e75a-4dd4-b688-8e21301f03e3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:34.703814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:34.704408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:34.704684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:34.704952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:34.713437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:34.715051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8553e1-8f83-4c52-9348-2c85cd81bd7e service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:34.724385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 753/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:38.885496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:38.886000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:38.886112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:38.887452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:38.892765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d63c-7049-4c8c-b0e8-2349297e0486 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:38.893143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d63c-7049-4c8c-b0e8-2349297e0486 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:38.893306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d63c-7049-4c8c-b0e8-2349297e0486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:38.913525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-35f4d63c-7049-4c8c-b0e8-2349297e0486 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:38.914749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-35f4d63c-7049-4c8c-b0e8-2349297e0486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:38.922424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:39.217999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:39.220094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:39.309028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103aee7-7675-4801-a946-64c5e2fcbb62 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:39.312860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:39.313468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:39.313742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:39.314013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:39.323180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:39.324596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba5ab-7006-407d-a483-db77d29cfe6c service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:39.334851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 776/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:41.510736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6934-df06-4903-93c2-1c01697fc67b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:41.511280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6934-df06-4903-93c2-1c01697fc67b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:41.511280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6934-df06-4903-93c2-1c01697fc67b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:41.512605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:41.517755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bad15-325e-4371-9c30-f936d5777622 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:41.518233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bad15-325e-4371-9c30-f936d5777622 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:41.518350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bad15-325e-4371-9c30-f936d5777622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:41.538793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-662bad15-325e-4371-9c30-f936d5777622 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:41.539972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-662bad15-325e-4371-9c30-f936d5777622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:41.547655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:41.832757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6934-df06-4903-93c2-1c01697fc67b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:41.844059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6934-df06-4903-93c2-1c01697fc67b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:41.847585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:41.848175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:41.848452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:41.849231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:41.858140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:41.859591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead66a9-bd34-4ae5-8453-ad22fd1a36f9 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:41.869433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 756/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:45.599019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:45.599754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:45.599754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:45.600925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:45.606060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a557bb-6e6d-4783-ac28-b859c69a146e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:45.606492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a557bb-6e6d-4783-ac28-b859c69a146e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:45.606658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a557bb-6e6d-4783-ac28-b859c69a146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:45.625787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c4a557bb-6e6d-4783-ac28-b859c69a146e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:45.627009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c4a557bb-6e6d-4783-ac28-b859c69a146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:45.635347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:22:45.937675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:45.939374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:46.016549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c973b-5aa5-4318-b3b1-3c81d81ae918 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:46.020122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:46.020727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:46.021018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:46.021290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:46.030057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:46.031520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ff786-9c87-4463-8836-4082bc382400 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:46.040990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 779/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:48.177481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:48.178080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:48.178080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:48.179418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 13:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:22:48.184790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d4e0-85d5-40ec-bf81-7c8b0c733321 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:48.185210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d4e0-85d5-40ec-bf81-7c8b0c733321 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:48.185319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53d4e0-85d5-40ec-bf81-7c8b0c733321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:48.204457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0e53d4e0-85d5-40ec-bf81-7c8b0c733321 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:22:48.205636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0e53d4e0-85d5-40ec-bf81-7c8b0c733321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:48.214358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 13:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:22:48.518828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:22:48.520486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:22:48.534053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079941a-0634-4fec-be1e-d60c5832502f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:22:48.537923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:22:48.538554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:22:48.538835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:22:48.539107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:22:48.547929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:22:48.549342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e031-c541-4cfb-bbf6-ad5f34d76d54 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:22:48.558711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 759/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:22:58.199577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:58.554489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=33 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:24.679837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e83a7-4dd3-4b90-b690-6d7187118aad None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.680952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e83a7-4dd3-4b90-b690-6d7187118aad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.681460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e83a7-4dd3-4b90-b690-6d7187118aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.704638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3ff2-498f-4577-9520-5937657f0549 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.705857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3ff2-498f-4577-9520-5937657f0549 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.705857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3ff2-498f-4577-9520-5937657f0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.714658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1d6e83a7-4dd3-4b90-b690-6d7187118aad None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.717240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1d6e83a7-4dd3-4b90-b690-6d7187118aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.733804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 781/1540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:24.738511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-619c3ff2-498f-4577-9520-5937657f0549 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.739949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-619c3ff2-498f-4577-9520-5937657f0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.749015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.749646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.750446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.758249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 760/1541] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 09 13:24:24.780735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.782029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.783524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.784035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.784555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.813064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 782/1542] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:24:24.822752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:24.832808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.834044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.846260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073296-3a1f-4ae2-b794-d2804649e32f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:24.850847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 761/1543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:24.858406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:24.859325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:24.860212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.860709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.861199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.862072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:24.862628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:24.864476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65156ae5-cf4d-4c5c-aafa-dde3f7eb98aa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:24.873342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3663ae7-8aac-482e-b62b-e5a49d8b38c3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:24.882567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 783/1544] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:24.882949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:24.883578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.883860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.884139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.884798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:24.885108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:24.886133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:24.886133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:24:24.886133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:24:24.887094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e3876-fb57-444b-9d62-80ecc0911f34 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:24.911884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.912754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.913249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.929023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 762/1545] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:24:24.930110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:24.930427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:24.930716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:24.950498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.952116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.958316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:24.963748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:24.975171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 763/1546] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:24.976057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:24.976291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 784/1547] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:24:24.977306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:24.995857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05cff5-3a21-4a58-a15c-73e97b8f6a32 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:24.997128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c6c2b-f9a7-4edc-9896-9660661bbe94 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.005552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.006183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.006500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.007003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.007125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.007652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.008215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.008713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.009209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.009568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a5550-4ccc-46b2-8b0c-05ee1049f200 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.010324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.011689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:25.011689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:24:25.011689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:24:25.014363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68a830-0a51-4cbb-af01-bbd0a6e1139f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.062653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 764/1548] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.062653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192e65-f702-48f2-b9c0-e98eb5d19da3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.062653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192e65-f702-48f2-b9c0-e98eb5d19da3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.062653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192e65-f702-48f2-b9c0-e98eb5d19da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.065331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 785/1549] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:24 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.066974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf5c-cbdf-4628-867b-c7580aca9055 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.067441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf5c-cbdf-4628-867b-c7580aca9055 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.067886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831adf5c-cbdf-4628-867b-c7580aca9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.085982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c1192e65-f702-48f2-b9c0-e98eb5d19da3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.087476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c1192e65-f702-48f2-b9c0-e98eb5d19da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.089792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-831adf5c-cbdf-4628-867b-c7580aca9055 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.091596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-831adf5c-cbdf-4628-867b-c7580aca9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.149385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 765/1550] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.150674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2bc8-8ba0-43db-b80e-628f5c4608a9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.150959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2bc8-8ba0-43db-b80e-628f5c4608a9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.151228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead2bc8-8ba0-43db-b80e-628f5c4608a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.152374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 786/1551] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.155565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.155854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.156290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.171593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-aead2bc8-8ba0-43db-b80e-628f5c4608a9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.172823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-aead2bc8-8ba0-43db-b80e-628f5c4608a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.176646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.177806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.180723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 766/1552] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.188574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.188574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.188574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.188871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 787/1553] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.188871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.199285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4113a07-2260-446e-b1c9-683fbb4b2aac None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.204139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.204732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.205012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.205287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.205951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.206088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.207247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.207940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd78f98-6630-4bcc-a73f-8389e8d7bb8d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.215709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 767/1554] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.216639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.225891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e5829-c7e1-4532-bb6d-c8cbae128223 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.232227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.232822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.233099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.233373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.234162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.235208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:25.235208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:24:25.235208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:24:25.236409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.242574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 788/1555] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/users => generated 303 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.242574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b7a-326e-44ae-8f29-27328004e417 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.242574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b7a-326e-44ae-8f29-27328004e417 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.242574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f3b7a-326e-44ae-8f29-27328004e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.262318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 768/1556] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.262318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.262760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-931f3b7a-326e-44ae-8f29-27328004e417 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.263351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-931f3b7a-326e-44ae-8f29-27328004e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.270511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69727-95e7-4e76-befe-fda0b6c34a44 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.271191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 789/1557] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.272359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900e56-0073-4464-af88-34c0c1d410b9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.272642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900e56-0073-4464-af88-34c0c1d410b9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.272911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4900e56-0073-4464-af88-34c0c1d410b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.275296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.275935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.276170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.276437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.277077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.277383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.279214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.291682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 769/1558] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.292593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.294386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c4900e56-0073-4464-af88-34c0c1d410b9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.295583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c4900e56-0073-4464-af88-34c0c1d410b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.303154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411691b6-a624-44c7-9ed9-61ee1d2a3155 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.303692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 790/1559] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.304869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.305144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.305411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.310947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.311544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.311854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.312100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.312744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.313047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.314684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c24f3-2044-4af7-922d-6f282a8a652e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.326100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.326827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 770/1560] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.327358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.328027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.328311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.328587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.335634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 791/1561] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.337876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.348689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b9a22-6b2a-4415-8a5c-f6be889d6703 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.352943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.353312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.353904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.354153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.354302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.354475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.355112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.356978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49de16-eb2c-4efb-b8c1-0c3f43927dcf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.362175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 771/1562] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.363554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.367242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 792/1563] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:25.368669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.368959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.369989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.373500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2958-7c5f-42e3-a330-6e25f837ea71 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.379041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.379633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.379912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.380182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.380823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.382439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.389405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:25.390644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:25.393219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 772/1564] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:25.394102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.400146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 793/1565] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:25.400868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.407079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a3b39-d3b6-4284-80cb-18b69a640f3a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.412040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.412625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.412903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.413175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.413374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460f3eb-207f-42fd-9863-c67642be49b6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.413798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.415747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.418001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.419453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.419854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.420130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.420775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.421079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.422687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.435201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 794/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.436018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.440138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:25.446707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4919-03e6-45a9-b866-4dd4bfbca9f1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.448493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 773/1567] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.449615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.468292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:25.508583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.509194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.509470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.509741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.510508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.512391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.513858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d23bc-7242-4ed5-9e0e-d6080b2fd4ac admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.518561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.519190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.519473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.519747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.520386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.520688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.522311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.534514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 774/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.535328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.545224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e79f3d-0122-4c95-b519-010dea1f134a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.548880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 795/1569] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.549909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.550536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.550814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.551086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.551371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.551721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.552024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.553604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.565973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 775/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.566868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.577380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14adb85-e939-41f2-98b1-fc063cd9bf52 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.614467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13004e5-ea62-48ac-b3d8-d240345cf4c6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.619133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.619739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.620018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.620289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.620924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.623213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.633034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 796/1571] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:25.633882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.635117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.635851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.636222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.636467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.637712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.639454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.644480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002c071-fe64-469d-b9b2-2f7be7ceb8c0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.649057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.649643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.649924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.650265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.650383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 776/1572] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:25.650906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:25.651175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.651284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.652811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.660896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342390-8099-4a8e-80a2-e3c557f42bca admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.664759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 797/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:25.665545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.665669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.666200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.666534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.666808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.667429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.669630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.676833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a09f-3e12-40d8-b812-c05004b80528 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.681347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.681969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.682203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.682564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.683220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.685764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.700087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 777/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.701066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.710630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 798/1575] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.711352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.722060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969da6c6-6f09-41d7-b3bd-420fbe8644da admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.763714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:25.768572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe69f-37a0-4524-8777-60ffcfa38121 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.776025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.776622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.776895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.777163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.778432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.780335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.781309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.781914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.782188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.782493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.783120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.785002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.806468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 799/1576] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.807257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.813881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 778/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.813881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.814140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:25.819572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17003041-0450-40e2-bfd8-e8f4f7db08fd admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.879696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.880405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.880863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.881213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.881346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7271-5867-4a57-91fa-0c8896603ca0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.881983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.883983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.885862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.886539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.886816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.887493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] PATH_INFO: `/v3/projects/0a1872b82bb744ada60233a095f9472b/users/88bf9a6cb8af44d8a01af7576d07db00/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.901423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1872b82bb744ada60233a095f9472b, user_id=88bf9a6cb8af44d8a01af7576d07db00, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.904624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.915700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 800/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:25.915700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.917992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 779/1579] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:25 2022] PUT /identity/v3/projects/0a1872b82bb744ada60233a095f9472b/users/88bf9a6cb8af44d8a01af7576d07db00/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:25.920039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:25.976736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4896a9-fee4-44d3-8b1a-7bdc9db37ae9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.981445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.982102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.982411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.982688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] PATH_INFO: `/v3/projects/c34348399d1747e48a10c9428a36b812/users/cec2a7fd7a004953a5f9d901c323f39e/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.983347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5b87d-cb68-40e9-8584-89fb1119ad0c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:25.987867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:25.988464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:25.988746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:25.989013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:25.989631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.991551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:25.997184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34348399d1747e48a10c9428a36b812, user_id=cec2a7fd7a004953a5f9d901c323f39e, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:25.998402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:25.998402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:24:25.998402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:24:26.000330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.015222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 801/1580] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:25 2022] PUT /identity/v3/projects/c34348399d1747e48a10c9428a36b812/users/cec2a7fd7a004953a5f9d901c323f39e/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.016006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.022667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 780/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:25 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:26.023496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.076642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:26.084953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ba4a-7908-4c60-ba74-ad53251e23c5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.089873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.091243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.091522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.091793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.092015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff648b-6885-498b-9fd0-4a31ba76f35c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.092422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.094415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.096616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.097208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.097485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.097756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.098421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.099987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.112200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 781/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.113499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.115574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:26.121136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 802/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:26.126175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.130415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c262e-02e1-450b-b042-f2f65c452efc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.135222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.135820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.136099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.136357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69e6d3-c72b-4ac0-9fde-43249d31d58b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.136463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.137038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.138866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.141550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.142135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.142442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.142713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.143335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.145219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9046a2-c58f-4316-9828-4a988ad115b1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.152196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 782/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.152196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.162014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ab90-83cd-42bb-b5a8-085ed888ea68 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.166864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.167351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.167639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.167900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.169146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.169933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 803/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:26.171087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09273772-9e37-4bac-83d9-c135d31f23b4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.171188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.171469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.171740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.191695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:26.192894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:26.193584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 783/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:26.194792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730590-0129-44b1-b796-d556f118f42a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.195078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730590-0129-44b1-b796-d556f118f42a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.195354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730590-0129-44b1-b796-d556f118f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.203509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 804/1587] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:26.204415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.214592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32404b0-6085-48da-a961-38c264ec20b7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.216815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-70730590-0129-44b1-b796-d556f118f42a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:26.218002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-70730590-0129-44b1-b796-d556f118f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:26.219300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.219923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.220182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.220450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.221077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.223064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.225822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 784/1588] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:26.226644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70730590-0129-44b1-b796-d556f118f42a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.236497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70730590-0129-44b1-b796-d556f118f42a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.241601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.242540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.242873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.243213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.243852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.245437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.251576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 805/1589] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:26.251576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.259592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30e23-c3d2-4dce-8e97-e1f339c7cbe8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.260824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 785/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.261563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.264771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.265369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.265644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.265911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.266592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.268195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.271333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2f08-e684-4395-9df7-58c7a00d0281 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.275883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.276464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.276742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.277014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.278381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.280140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.280681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 806/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.281689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.293009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 786/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.293009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.295968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9fad6-ef4c-4326-bb01-29436325505b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.300380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe4753-56cc-4ba1-a292-dc7d21ca146f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.301542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.302256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.302591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.302807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.303491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.304916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.305058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.305483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.305764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.306036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.306696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.308249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.317101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 807/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.317954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.323220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 787/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.323220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.377979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771812-519f-4d8b-b395-ef1bbac7bb6a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.378521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8caa-9072-4851-9280-fec94cc15204 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.381694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.382070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.382316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.382589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.382712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.382856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.382965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.383203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.392827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.393197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.394280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.394655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.403922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 788/1595] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:26.404367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 808/1596] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:26.404644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.405053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.413812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52659a3-5805-46b3-aa14-47390b5b8845 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.414843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8d65-ca05-493a-b29b-faecb6ce0214 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.419385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.419981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.420256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.420522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.420786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.421152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.421459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.421743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.422021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] PATH_INFO: `/v3/projects/6b5cb3820d334c09a0ff64519331c8ee/users/91786707d68f4a18a35031db85066d50/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.422832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.436414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 789/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.436414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.442122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5cb3820d334c09a0ff64519331c8ee, user_id=91786707d68f4a18a35031db85066d50, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.445391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.446001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33241326-8fac-4b0b-be90-04256d976414 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.453748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.454517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.454969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.455334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.456099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.458366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.465056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 809/1598] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/6b5cb3820d334c09a0ff64519331c8ee/users/91786707d68f4a18a35031db85066d50/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.466004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.477212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 790/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.477212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.486142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823013-3052-4409-b4e3-21d479414c68 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.540464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd64c9-9d53-4d3d-9191-32a9d3055800 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.547240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.548144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.548753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.549139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] PATH_INFO: `/v3/projects/8cb2ff7cadb14cc39fd267f8f34910c1/users/55477ef8349344ee8722fc67cbca68c9/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.556053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:26.566240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.567003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.567560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.568447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.569394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.570491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb2ff7cadb14cc39fd267f8f34910c1, user_id=55477ef8349344ee8722fc67cbca68c9, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.571686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.576126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.585776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 791/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.586747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.591882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:26.598401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83df22-96a8-4070-a4a4-76008e5ff785 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.599381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 810/1601] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/8cb2ff7cadb14cc39fd267f8f34910c1/users/55477ef8349344ee8722fc67cbca68c9/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.600327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.678476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.679283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.679689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.680061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.680770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.682460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d0501-c1b5-487f-b26c-1a2110a61c8e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.688001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8402b-c3bf-41e6-8c8d-a5f215c4989f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.692974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.693595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.693883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.694348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.694997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.696599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.697913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 792/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.699330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.700157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.700431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.712909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 811/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:26.712909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.721812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:26.722979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:26.724880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18644d02-10ae-4067-9814-b9b6df729263 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.729633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.730400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.730785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.731144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] PATH_INFO: `/v3/projects/236c1ca7807c45bd9d2076572ba3500b/users/84deda7b4cee4c76812cf3ee0c2735f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.735383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 793/1604] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:26.735383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.744710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883c1d-7a5d-4f2c-a8c9-10b15fe78b44 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.751365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236c1ca7807c45bd9d2076572ba3500b, user_id=84deda7b4cee4c76812cf3ee0c2735f8, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.751822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.752496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.752773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.753045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] PATH_INFO: `/v3/projects/1f91b72440db47abb08aa95c4ddcf4a0/users/67241ef1a1e444e183b4c5d0fa6aaada/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.754611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e81d25-cd72-4a5e-893c-e2b4c1d715d4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.770597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 812/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/236c1ca7807c45bd9d2076572ba3500b/users/84deda7b4cee4c76812cf3ee0c2735f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.770843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f91b72440db47abb08aa95c4ddcf4a0, user_id=67241ef1a1e444e183b4c5d0fa6aaada, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.772844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.773300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.773463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.773896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.804957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 794/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/1f91b72440db47abb08aa95c4ddcf4a0/users/67241ef1a1e444e183b4c5d0fa6aaada/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.804957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.827112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] MFA Rules not processed for user `55477ef8349344ee8722fc67cbca68c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:26.828549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:26.879420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb778-e95d-454f-8986-cdf6783a4687 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:26.885392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:26.886082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:26.886395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:26.886781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] PATH_INFO: `/v3/projects/267bf8f75aee458cbbfd3be60adf7da7/users/be24c711d7a94c9bafc6295e08bdd2e2/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:26.909004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267bf8f75aee458cbbfd3be60adf7da7, user_id=be24c711d7a94c9bafc6295e08bdd2e2, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:26.911878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:26.937343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 813/1608] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:26.938364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.942927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 795/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/267bf8f75aee458cbbfd3be60adf7da7/users/be24c711d7a94c9bafc6295e08bdd2e2/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:26.944105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:26.947019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:26.953488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c770cdb-cfdc-4b5a-80c3-5828dc5947de None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:27.028184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.045009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:27.045303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d562bd-c8c6-40b4-a279-c8c4c8845480 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:27.046720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.047262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.047912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] PATH_INFO: `/v3/projects/9301a5dbc4524cb5b6628588ed8cce37/users/077cb54664e6457dbd31dae1708e8639/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.052305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:27.055295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.056937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.057649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.060191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.083981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9301a5dbc4524cb5b6628588ed8cce37, user_id=077cb54664e6457dbd31dae1708e8639, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:27.086709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b8230-437a-4d63-9660-a8d2e9d3d139 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:27.097492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:27.099848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f017-9027-4a60-a024-2105a7380a93 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:27.112202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 814/1609] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:26 2022] PUT /identity/v3/projects/9301a5dbc4524cb5b6628588ed8cce37/users/077cb54664e6457dbd31dae1708e8639/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:27.112202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007f0e-03de-4581-8ee0-5810779b6980 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.112503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007f0e-03de-4581-8ee0-5810779b6980 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.115223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04007f0e-03de-4581-8ee0-5810779b6980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.128682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 796/1610] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:27.133997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050ff4-80f4-4bfc-86e0-ff8077b2a25f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.134490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050ff4-80f4-4bfc-86e0-ff8077b2a25f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.135605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050ff4-80f4-4bfc-86e0-ff8077b2a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.166271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-04007f0e-03de-4581-8ee0-5810779b6980 None None] MFA Rules not processed for user `84deda7b4cee4c76812cf3ee0c2735f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.167513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-04007f0e-03de-4581-8ee0-5810779b6980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.204262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fc050ff4-80f4-4bfc-86e0-ff8077b2a25f None None] MFA Rules not processed for user `67241ef1a1e444e183b4c5d0fa6aaada`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.207157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fc050ff4-80f4-4bfc-86e0-ff8077b2a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.264088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 815/1611] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.265587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.265975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.266326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.305772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] MFA Rules not processed for user `be24c711d7a94c9bafc6295e08bdd2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.307792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.366110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 797/1612] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.367709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548617-2c92-4ab6-8a3f-62159cc46bf8 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.368110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548617-2c92-4ab6-8a3f-62159cc46bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.368480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548617-2c92-4ab6-8a3f-62159cc46bf8 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.370298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 798/1613] 10.222.0.42 () {54 vars in 962 bytes} [Fri Sep 9 13:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:27.372340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0d81-0987-440d-9244-17b410d704b4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.373116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0d81-0987-440d-9244-17b410d704b4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.373664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef0d81-0987-440d-9244-17b410d704b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.404823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-82ef0d81-0987-440d-9244-17b410d704b4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.406428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-82ef0d81-0987-440d-9244-17b410d704b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.427563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 816/1614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.433869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:27.527367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb054-8194-40e5-bca1-fdb1108b0467 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:27.538532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:27.539339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.539615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.539890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.541190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:27.542853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 799/1615] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.544243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:27.545202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90f2-7329-4f49-91f4-932a323846f4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.545486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90f2-7329-4f49-91f4-932a323846f4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.545757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd90f2-7329-4f49-91f4-932a323846f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.561735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.604654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 817/1616] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:27.606319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:27.612633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bfcd90f2-7329-4f49-91f4-932a323846f4 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.614457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bfcd90f2-7329-4f49-91f4-932a323846f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.697087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b83e6-7b71-474f-8bc9-ea6c6dc49601 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:27.702838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:27.703764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.704329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.704882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.721460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.739198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 800/1617] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.740774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5e79-571c-4505-8c44-c4f1d57b722b None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.741232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5e79-571c-4505-8c44-c4f1d57b722b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.741557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea5e79-571c-4505-8c44-c4f1d57b722b None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.743714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 801/1618] 10.222.0.42 () {54 vars in 962 bytes} [Fri Sep 9 13:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:27.744934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.745266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.745555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.795432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] MFA Rules not processed for user `88bf9a6cb8af44d8a01af7576d07db00`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:27.796905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:27.810127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:27.811704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:27.830157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 818/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:27.830157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:27.927200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4045da-32ab-4e53-b98c-489f10b6cc05 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:27.941587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:27.942259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:27.942557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:27.942841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:27.955528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 802/1620] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:27.956498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.064579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:28.085561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.088499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a203a6a-50f8-4b19-a3b8-44aafe628ac8 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.102800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161340-3135-4e9d-ac82-8558137cbfd9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.110127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 819/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:28.113157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.114757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.115362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.117881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.118753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.119152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.122494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.123191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.125216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.160036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:28.163022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:28.169668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 803/1622] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:27 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:28.172552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.202040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 820/1623] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Sep 9 13:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:28.204497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.204918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836614a8-e428-45c9-b645-ce2ddfce46e7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.218142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.218931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.219303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.219782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.240903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3056e-7001-4252-95d5-e92f836b0b73 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.255019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.256495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.257250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.257250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.259002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.263655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.335849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 821/1624] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:28 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:28.335849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.357309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.359523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.399080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 804/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:28.404510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.436562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d74fe-0df0-46b2-a7b9-1decaf6a5e59 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.457789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:28.463554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30e9e-073d-44e1-8f4c-262a8ff63185 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.473343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.474321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.474462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.474798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.475522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.477250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.502242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 822/1626] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:28.503623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.536542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f261421-3ac0-4def-86f1-b15efb13edf8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.556337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.556985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.560483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.560848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.564028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.571817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.640115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 823/1627] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:28 2022] POST /identity/v3/users => generated 308 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:28.640976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.647899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.648534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.648816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.649092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.671141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb638a0-d563-4ee6-904d-f6d3d29126e1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:28.690993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:28.691690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:28.691976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:28.692255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] PATH_INFO: `/v3/projects/87456e3f31594eb6a36d447353f88a96/users/19f27b982a9d4f659f6a0231dddf0d11/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:28.751620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87456e3f31594eb6a36d447353f88a96, user_id=19f27b982a9d4f659f6a0231dddf0d11, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.756961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.791961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:28.794026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:28.798553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 824/1628] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:28 2022] PUT /identity/v3/projects/87456e3f31594eb6a36d447353f88a96/users/19f27b982a9d4f659f6a0231dddf0d11/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:28.799578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.825734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 805/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:28.832650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:28.863932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff0aee-54d1-413c-9141-377a188adf93 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.011293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac632c1-b130-4fba-963c-1c2c720c0911 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.032246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.032989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.033281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.035085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.038483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.039093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.039205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.039425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.039637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.040293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.041906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.044927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.077450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 806/1630] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:29.084708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 825/1631] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:29.085381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.086665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.108487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981176b-aa3c-465d-ab15-cb88886478f9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.114121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132785f-57b6-4992-a3e7-175869ca073c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.121033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.122582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.122901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.123177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] PATH_INFO: `/v3/projects/852df70b8649483089938d992dfd5124/users/70ad0b31ee0a4e53a77020bc731978d4/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.144280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.144875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.145222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.145504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] PATH_INFO: `/v3/projects/87456e3f31594eb6a36d447353f88a96/users/19f27b982a9d4f659f6a0231dddf0d11/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.146144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:29.151599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87456e3f31594eb6a36d447353f88a96, user_id=19f27b982a9d4f659f6a0231dddf0d11, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.151818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852df70b8649483089938d992dfd5124, user_id=70ad0b31ee0a4e53a77020bc731978d4, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.154407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86816f3-8b8d-4dbd-beec-6c51868df1c5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.155123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef163fd3-eb65-4242-a986-f58100bb3659 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.176035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 826/1632] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:29 2022] PUT /identity/v3/projects/852df70b8649483089938d992dfd5124/users/70ad0b31ee0a4e53a77020bc731978d4/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:29.177070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4d12-fea9-4918-939b-1c5233b22a85 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.177407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4d12-fea9-4918-939b-1c5233b22a85 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.178050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4d12-fea9-4918-939b-1c5233b22a85 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.179653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 827/1633] 10.222.0.42 () {54 vars in 912 bytes} [Fri Sep 9 13:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:29.180718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a4d12-fea9-4918-939b-1c5233b22a85 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.186256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 807/1634] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:29 2022] PUT /identity/v3/projects/87456e3f31594eb6a36d447353f88a96/users/19f27b982a9d4f659f6a0231dddf0d11/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:29.187689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.187932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.188190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.251772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:29.253453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:29.308865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:29.309301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a4d12-fea9-4918-939b-1c5233b22a85 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.321718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.321967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.322389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.322563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.323735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.326699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06481ac1-5f0d-4074-b20e-4aa0cb238815 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.357585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 828/1635] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:29.357585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623d8f-710d-4957-bd37-9ca89e05f14c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.357585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623d8f-710d-4957-bd37-9ca89e05f14c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.357585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623d8f-710d-4957-bd37-9ca89e05f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.404399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 808/1636] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:29.410288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.420126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-40623d8f-710d-4957-bd37-9ca89e05f14c None None] MFA Rules not processed for user `19f27b982a9d4f659f6a0231dddf0d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:29.421344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-40623d8f-710d-4957-bd37-9ca89e05f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:29.433953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55af1a-af6c-4336-b9d6-2cd51709320a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.439990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.440686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.441040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.441395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] PATH_INFO: `/v3/projects/852df70b8649483089938d992dfd5124/users/70ad0b31ee0a4e53a77020bc731978d4/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.443600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=852df70b8649483089938d992dfd5124, user_id=70ad0b31ee0a4e53a77020bc731978d4, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.446494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.459049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 809/1637] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:29 2022] PUT /identity/v3/projects/852df70b8649483089938d992dfd5124/users/70ad0b31ee0a4e53a77020bc731978d4/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:29.459990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.552540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 829/1638] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:29.554972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594211-ab16-4995-90f4-2783672ee828 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.555262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594211-ab16-4995-90f4-2783672ee828 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.555540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594211-ab16-4995-90f4-2783672ee828 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.558405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 830/1639] 10.222.0.42 () {54 vars in 912 bytes} [Fri Sep 9 13:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:29.559453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594211-ab16-4995-90f4-2783672ee828 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:29.594967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273b519-13ec-420b-8031-d009ec6371fc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.600362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.601358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.601708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.601990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.695398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594211-ab16-4995-90f4-2783672ee828 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:29.702537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:29.703909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.705780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.705921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.755658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:29.781901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.783797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e3b2a-ceaf-4f57-aaac-85a078d19173 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.811111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:29.812386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 810/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:29.812707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:29.814057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:29.814538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:29.814986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:29.827050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 831/1641] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:24:29.865407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:29.867851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:29.904246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 811/1642] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:24:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:30.079482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:30.098372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebbcf-3161-453f-a6bf-5e2af1498df9 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:30.124352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:30.126443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:30.127865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:30.129636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:30.147787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:30.152372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033499-5c3e-4701-85b6-0dfdaa407c2c service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:30.195670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 832/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:30.368540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:30.380068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c4a00-3a7d-40b5-bbf1-598af0ff8fbb None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:30.393677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:30.394325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:30.394601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:30.394871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:30.489790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:30.523105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:30.526861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:30.541339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 812/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:32.576219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab45cf-deea-4827-9b8a-5f2618e1e3c7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:32.576713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab45cf-deea-4827-9b8a-5f2618e1e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:32.576937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab45cf-deea-4827-9b8a-5f2618e1e3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:32.689092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1fab45cf-deea-4827-9b8a-5f2618e1e3c7 None None] MFA Rules not processed for user `70ad0b31ee0a4e53a77020bc731978d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:32.704859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1fab45cf-deea-4827-9b8a-5f2618e1e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:32.999609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 833/1645] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:34.037221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:34.282788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a9ff7-0360-4b86-b066-ebb8701e3c89 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:34.295726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:34.296588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:34.297034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:34.297327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] PATH_INFO: `/v3/users/55477ef8349344ee8722fc67cbca68c9` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:34.300795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55477ef8349344ee8722fc67cbca68c9)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:34.303087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:34.422428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55477ef8349344ee8722fc67cbca68c9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:34.426671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55477ef8349344ee8722fc67cbca68c9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:34.427374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55477ef8349344ee8722fc67cbca68c9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:34.443083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55477ef8349344ee8722fc67cbca68c9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:34.480646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55477ef8349344ee8722fc67cbca68c9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:34.508430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 813/1646] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:34 2022] DELETE /identity/v3/users/55477ef8349344ee8722fc67cbca68c9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:34.512191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195329-f495-4472-b2ad-d56380d77b11 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:34.512706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195329-f495-4472-b2ad-d56380d77b11 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:34.512706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195329-f495-4472-b2ad-d56380d77b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:34.557707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ec195329-f495-4472-b2ad-d56380d77b11 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:34.560629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ec195329-f495-4472-b2ad-d56380d77b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:34.709722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 834/1647] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:34.758695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:34.766096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:35.042518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0944e52-cd6b-4a72-9d0e-0d7896f25c58 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:35.051322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:35.052459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:35.054284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:35.055342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:35.077652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:35.079214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f473b6-12c4-4851-a061-e74b07a9f7c2 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:35.104911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 814/1648] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:35.902418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:35.903116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:35.903116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:35.904612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 835/1649] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:36.023139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:36.023139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:36.023139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:36.030879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:36.075578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:36.078595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:36.195874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 815/1650] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:36.261650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:36.264795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:36.300045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64eed14-bdef-4022-bc43-f065415f4909 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:36.314449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:36.316117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:36.316630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:36.317120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:36.336718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:36.339020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68751083-2c92-4441-9d8f-b605566f4b15 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:36.380363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 836/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:36.633783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:36.635321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:36.663742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c9876-81a4-4a6e-84d8-159e4c21e0bf None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:36.678569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:36.679288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:36.679568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:36.680034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] PATH_INFO: `/v3/projects/8cb2ff7cadb14cc39fd267f8f34910c1` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:36.685141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb2ff7cadb14cc39fd267f8f34910c1)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:36.687099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: WARNING py.warnings [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:36.687099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: warnings.warn(msg) Sep 09 13:24:36.687099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: Sep 09 13:24:36.688407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:36.853088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb2ff7cadb14cc39fd267f8f34910c1', 'request_id': 'req-aa69a22f-2b33-4441-ad11-d2a6344fab56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:36.898166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb2ff7cadb14cc39fd267f8f34910c1', 'request_id': 'req-aa69a22f-2b33-4441-ad11-d2a6344fab56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:36.924262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb2ff7cadb14cc39fd267f8f34910c1', 'request_id': 'req-aa69a22f-2b33-4441-ad11-d2a6344fab56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:36.958651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] The token cache is being invalidate because project 8cb2ff7cadb14cc39fd267f8f34910c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:36.959032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:36.959696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-aa69a22f-2b33-4441-ad11-d2a6344fab56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:36.961851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 816/1652] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:36 2022] DELETE /identity/v3/projects/8cb2ff7cadb14cc39fd267f8f34910c1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:36.968469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:36.969144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:36.969435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:37.025398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:37.029903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:37.071884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:37.264605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 837/1653] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:37.266325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:37.266766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:37.267014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:37.330400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:37.335457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:37.377192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 817/1654] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:37.377384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:37.387973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80539d8-4e69-4044-a272-4d1f49afb9c4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:37.409057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:37.412782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:37.413072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:37.413347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:37.418196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:37.419497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:37.426233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:37.475665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:37.485527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 838/1655] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:37.489015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77215ddd-aa0b-4551-85f2-913fed9ddaf9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:37.507165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:37.512978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:37.513566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:37.514013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:37.515231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:37.519043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:37.656668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 818/1656] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:37 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:37.661235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:37.680184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793352d3-d667-48e5-9645-696b5503f48b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:37.935434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:37.937197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:37.937554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:37.937898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:37.938687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:37.940890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:37.978540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 839/1657] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:37 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:37.981391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:37.995693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98610db7-dc8a-44e9-95b3-44a1c049649e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.004760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:38.005590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.006033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.006510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.007480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:38.009482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:38.026938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 819/1658] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:38.031955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.069366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea63e0-3fe9-4ec2-be1f-19d50988df84 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.089072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:38.089359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.089746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.091096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.092226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:38.094324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:38.149144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 840/1659] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:24:38.154479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.185285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71568bb-cca6-41fc-8731-52427fde545f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.208458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:38.211018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.214370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.214835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:38.216600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.217894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] PATH_INFO: `/v3/projects/a262a7daaef840b1985b3f0601cd9a1e/users/13db6ac74da0486da60bd26ca5ef8b18/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.257002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9d698-0cd4-4e98-95b3-7d911f492fe3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.266839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a262a7daaef840b1985b3f0601cd9a1e, user_id=13db6ac74da0486da60bd26ca5ef8b18, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:38.273495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845d6e6-d4a5-44fd-b86f-70e0ea68b687 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:38.276251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:38.277187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.278270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.280449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] PATH_INFO: `/v3/users/be24c711d7a94c9bafc6295e08bdd2e2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.282325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be24c711d7a94c9bafc6295e08bdd2e2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:38.287261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 13:24:38.287261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 13:24:38.287261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: Sep 09 13:24:38.289708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:38.315854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 820/1660] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:38 2022] PUT /identity/v3/projects/a262a7daaef840b1985b3f0601cd9a1e/users/13db6ac74da0486da60bd26ca5ef8b18/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:38.327333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.327618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.328194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.423593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] MFA Rules not processed for user `13db6ac74da0486da60bd26ca5ef8b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:38.426022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:38.436510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be24c711d7a94c9bafc6295e08bdd2e2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:38.438267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be24c711d7a94c9bafc6295e08bdd2e2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:38.441049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:38.450620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be24c711d7a94c9bafc6295e08bdd2e2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:38.481505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be24c711d7a94c9bafc6295e08bdd2e2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:38.522808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb16c918-18c6-40f6-8e80-2d088fc00805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be24c711d7a94c9bafc6295e08bdd2e2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:38.527418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:38.557149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 841/1661] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:38 2022] DELETE /identity/v3/users/be24c711d7a94c9bafc6295e08bdd2e2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:38.560321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.560637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.560926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.595636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 821/1662] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:38.597758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:38.599299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:38.600479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.602278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:38.721181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 842/1663] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:38.761411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054417e2-3ad3-406d-9153-e611723586d0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.771827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.773814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:38.776720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:38.777536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:38.778185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:38.778832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:38.779612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:38.781614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:38.845520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 822/1664] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:38 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:38.849278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:38.941879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ca467-cf8e-4152-aaa8-726414ff33dd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:38.988643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ee9a-4bc4-4a41-92d0-75227dfd1027 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.005129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.011123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.011449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.011737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.013672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.024056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642a4f-1b29-4e81-8c46-f2081ceee1e1 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.058813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.062619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.063115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.063388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.074183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 823/1665] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:38 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:39.077012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248332-d60f-473d-ab51-291caf7044ca None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.077450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248332-d60f-473d-ab51-291caf7044ca None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.079336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17248332-d60f-473d-ab51-291caf7044ca None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.083188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 824/1666] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:24:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:39.083936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248332-d60f-473d-ab51-291caf7044ca None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:39.093776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.095271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a1de4-2af1-4cb1-b5df-440b30bbc654 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.117686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 843/1667] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:24:39.132414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17248332-d60f-473d-ab51-291caf7044ca None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.135119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.135410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.139286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.144154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.145085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.146145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.155697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.156822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.158768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.181107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 825/1668] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:39.189224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:39.201652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:39.204213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:39.225842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54d0f7-5acc-46d7-b606-cebf0bb407a1 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.233265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.234510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.234864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.235148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] PATH_INFO: `/v3/projects/6bf18f42ef484ed78fb9dc5708b75245/users/7b429ee502d7463dae4de2ae02c254a3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.260140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:39.265706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf18f42ef484ed78fb9dc5708b75245, user_id=7b429ee502d7463dae4de2ae02c254a3, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.283390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.316534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 826/1669] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:39 2022] PUT /identity/v3/projects/6bf18f42ef484ed78fb9dc5708b75245/users/7b429ee502d7463dae4de2ae02c254a3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:39.321510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:39.326668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:39.369593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:39.409297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 844/1670] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:24:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:39.411900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:39.447360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86dbc-7dc6-4504-95f7-393f129de871 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.598123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ac40-32f4-4219-a81a-4d578250d05b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.609074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.609819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.611402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.611402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.612907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.614908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.630116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.636162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.636454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.636734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] PATH_INFO: `/v3/users/88bf9a6cb8af44d8a01af7576d07db00` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.639339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 845/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:39.640504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:39.642793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:39.648078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bf9a6cb8af44d8a01af7576d07db00)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.658367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.822192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bf9a6cb8af44d8a01af7576d07db00'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:39.825684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bf9a6cb8af44d8a01af7576d07db00'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:39.827138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bf9a6cb8af44d8a01af7576d07db00'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:39.870701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092bd7-552f-4c32-9226-6968584cbb1f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:39.874315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bf9a6cb8af44d8a01af7576d07db00'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:39.885199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:39.887112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:39.887656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:39.888752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:39.892180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:39.979932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:39.989297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bc80c-01d9-4c73-9262-9e1bea3aee54 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:39.996001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bf9a6cb8af44d8a01af7576d07db00'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:40.032538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 827/1672] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:39 2022] DELETE /identity/v3/users/88bf9a6cb8af44d8a01af7576d07db00 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:40.035800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:40.037724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:40.064730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 846/1673] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:40.286274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a59388-671f-479d-b0df-3b5801650eb6 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:40.303581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:40.305214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:40.305962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:40.306270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] PATH_INFO: `/v3/projects/6bf18f42ef484ed78fb9dc5708b75245/users/7b429ee502d7463dae4de2ae02c254a3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:40.311545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf18f42ef484ed78fb9dc5708b75245, user_id=7b429ee502d7463dae4de2ae02c254a3, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:40.316652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d49ebc-546b-4245-9977-c773f6c2159b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:40.350690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 828/1674] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:40 2022] PUT /identity/v3/projects/6bf18f42ef484ed78fb9dc5708b75245/users/7b429ee502d7463dae4de2ae02c254a3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:40.361010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:40.361796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:40.362274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:40.407474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] MFA Rules not processed for user `7b429ee502d7463dae4de2ae02c254a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:40.409264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:40.454255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:40.454453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:40.456003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:40.487679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:40.570931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] MFA Rules not processed for user `cec2a7fd7a004953a5f9d901c323f39e`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:40.573487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:40.588441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 847/1675] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:40.599490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:40.603544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:40.619682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:40.764395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62418ec-1f50-4cea-8120-bfd5920e305d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:40.774126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:40.792472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:40.794412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:40.794895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:40.823118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:40.826980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2483f-d418-4371-b2a0-11336d12113b service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:40.872602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 848/1676] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:24:40.921817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 829/1677] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:40.945389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777624-3d66-4ce5-87a6-28566a99deb5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:40.946141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777624-3d66-4ce5-87a6-28566a99deb5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:40.946659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777624-3d66-4ce5-87a6-28566a99deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:40.991859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f8777624-3d66-4ce5-87a6-28566a99deb5 None None] MFA Rules not processed for user `cec2a7fd7a004953a5f9d901c323f39e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:40.993266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f8777624-3d66-4ce5-87a6-28566a99deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.036310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 849/1678] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:41.048775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:41.050318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.151657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.152113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.152190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:41.254009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] MFA Rules not processed for user `91786707d68f4a18a35031db85066d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:41.255318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.328087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8e4d5-c1d8-433f-8e6e-2e0c74e1b3dc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:41.355034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:41.356504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.366416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.367511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:41.391500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:41.393557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:41.417083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 830/1679] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:41.489484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 850/1680] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:41.505141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:41.507923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.564994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a6f0-c3e4-4139-9d0b-07375f8c357e service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:41.576298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:41.576930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.577367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.577647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:41.588554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:41.590011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.602015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:41.604738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:41.655048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 831/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:41.738860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d4507-01f7-4ef5-9886-4d59fb707338 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:41.764401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:41.765703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.766289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.766701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] PATH_INFO: `/v3/users/84deda7b4cee4c76812cf3ee0c2735f8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:41.768408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=84deda7b4cee4c76812cf3ee0c2735f8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:41.770540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:41.853251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:41.869853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84deda7b4cee4c76812cf3ee0c2735f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:41.872134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84deda7b4cee4c76812cf3ee0c2735f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:41.888776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:41.890608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:41.901796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84deda7b4cee4c76812cf3ee0c2735f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:41.914533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a85-a9c9-45d2-860f-719a07dd3c03 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:41.941523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:41.942187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.946080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84deda7b4cee4c76812cf3ee0c2735f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:41.949495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.950671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] PATH_INFO: `/v3/projects/0a1872b82bb744ada60233a095f9472b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:41.954590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1872b82bb744ada60233a095f9472b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:41.957616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-884cc06c-2fa2-441e-b7a9-19605ea95ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84deda7b4cee4c76812cf3ee0c2735f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:41.967576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 851/1682] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:41 2022] DELETE /identity/v3/users/84deda7b4cee4c76812cf3ee0c2735f8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:41.973518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:41.974407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:41.974875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:41.975343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.020640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:42.022269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.114985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1872b82bb744ada60233a095f9472b', 'request_id': 'req-89b6db62-63e5-41fe-a3f0-5099d571ddec'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.129777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1872b82bb744ada60233a095f9472b', 'request_id': 'req-89b6db62-63e5-41fe-a3f0-5099d571ddec'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.144721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:42.154275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1872b82bb744ada60233a095f9472b', 'request_id': 'req-89b6db62-63e5-41fe-a3f0-5099d571ddec'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.163630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 852/1683] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:42.163630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:42.163630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.188257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615651bf-90c5-4b29-a352-805c400f36ad None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:42.188780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] The token cache is being invalidate because project 0a1872b82bb744ada60233a095f9472b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:42.189235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.194799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.199344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 832/1684] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:41 2022] DELETE /identity/v3/projects/0a1872b82bb744ada60233a095f9472b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:42.199344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:42.199344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.331297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:42.332137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.332422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.333997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] PATH_INFO: `/v3/users/13db6ac74da0486da60bd26ca5ef8b18` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.339437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] RBAC: Authorizing `identity:delete_user(user_id=13db6ac74da0486da60bd26ca5ef8b18)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:42.342494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:42.352521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6db62-63e5-41fe-a3f0-5099d571ddec admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:42.368439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:42.369671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.372564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.373015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] PATH_INFO: `/v3/users/67241ef1a1e444e183b4c5d0fa6aaada` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.375860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67241ef1a1e444e183b4c5d0fa6aaada)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:42.378103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:42.472992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13db6ac74da0486da60bd26ca5ef8b18'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.474290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13db6ac74da0486da60bd26ca5ef8b18'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.484869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:42.491912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13db6ac74da0486da60bd26ca5ef8b18'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.510656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67241ef1a1e444e183b4c5d0fa6aaada'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.512627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67241ef1a1e444e183b4c5d0fa6aaada'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.514039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67241ef1a1e444e183b4c5d0fa6aaada'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.529767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67241ef1a1e444e183b4c5d0fa6aaada'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.539905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13db6ac74da0486da60bd26ca5ef8b18'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.553898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13db6ac74da0486da60bd26ca5ef8b18'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.561748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67241ef1a1e444e183b4c5d0fa6aaada'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.566271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 853/1685] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:42 2022] DELETE /identity/v3/users/13db6ac74da0486da60bd26ca5ef8b18 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:42.568521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:42.570854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.586026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 833/1686] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:42 2022] DELETE /identity/v3/users/67241ef1a1e444e183b4c5d0fa6aaada => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:42.587298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:42.589214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.679845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0cc19-6ddf-4981-b666-8bedf4e1c7d9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:42.691024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:42.691670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.692062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.692426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.696005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.728977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15852-78f6-4bf4-bfa7-2933044e417c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:42.745639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:42.853344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:42.855082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe9ffe-7938-404a-833a-8b5742451001 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:42.869151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:42.869818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.870100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.870402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] PATH_INFO: `/v3/users/70ad0b31ee0a4e53a77020bc731978d4` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.883362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ad0b31ee0a4e53a77020bc731978d4)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:42.884744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 834/1687] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:42.885213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:42.886298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.886592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.887009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.889572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 835/1688] 10.222.0.42 () {54 vars in 912 bytes} [Fri Sep 9 13:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:42.890457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:42.892773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:42.920553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b3c1a-47ca-49b0-a8d7-0da310c47142 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:42.930719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:42.931874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:42.933056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:42.934683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] PATH_INFO: `/v3/projects/267bf8f75aee458cbbfd3be60adf7da7` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:42.937261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267bf8f75aee458cbbfd3be60adf7da7)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:42.939904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:42.976984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ad0b31ee0a4e53a77020bc731978d4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.979016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ad0b31ee0a4e53a77020bc731978d4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:42.998199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ad0b31ee0a4e53a77020bc731978d4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.026391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ad0b31ee0a4e53a77020bc731978d4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.038539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.044682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-14abc0f8-202a-425d-b2fb-949ad712c4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ad0b31ee0a4e53a77020bc731978d4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.053140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267bf8f75aee458cbbfd3be60adf7da7', 'request_id': 'req-0c441f9e-be0b-48fc-953f-b4f10ef2d996'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.058473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 854/1689] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:42 2022] DELETE /identity/v3/users/70ad0b31ee0a4e53a77020bc731978d4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:43.060706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f123c16-336f-4aed-871b-e606d4901ada None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.061872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f123c16-336f-4aed-871b-e606d4901ada None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.063797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f123c16-336f-4aed-871b-e606d4901ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.067604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267bf8f75aee458cbbfd3be60adf7da7', 'request_id': 'req-0c441f9e-be0b-48fc-953f-b4f10ef2d996'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.076994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267bf8f75aee458cbbfd3be60adf7da7', 'request_id': 'req-0c441f9e-be0b-48fc-953f-b4f10ef2d996'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.102690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] The token cache is being invalidate because project 267bf8f75aee458cbbfd3be60adf7da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:43.102986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.104753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0c441f9e-be0b-48fc-953f-b4f10ef2d996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:43.107184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1f123c16-336f-4aed-871b-e606d4901ada None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.112504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1f123c16-336f-4aed-871b-e606d4901ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.113247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 836/1690] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:42 2022] DELETE /identity/v3/projects/267bf8f75aee458cbbfd3be60adf7da7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:43.115389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ace88-c264-4f8c-8f4c-310b73d89b8e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.115558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ace88-c264-4f8c-8f4c-310b73d89b8e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.116227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ace88-c264-4f8c-8f4c-310b73d89b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.148604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-de5ace88-c264-4f8c-8f4c-310b73d89b8e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.150876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-de5ace88-c264-4f8c-8f4c-310b73d89b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.272509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 855/1691] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.272509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa382b62-aa5c-4b57-b82c-77b35715e3f9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.272509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa382b62-aa5c-4b57-b82c-77b35715e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.272509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa382b62-aa5c-4b57-b82c-77b35715e3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.307473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 837/1692] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.310282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.311801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.312174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.345214 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-aa382b62-aa5c-4b57-b82c-77b35715e3f9 None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.346616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aa382b62-aa5c-4b57-b82c-77b35715e3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.359111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.364156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.386303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 838/1693] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.386303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.386303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.466433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.487590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 856/1694] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.494802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.495417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.495558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.546945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.548189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.565412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b587-4525-4cd9-96aa-a3db236ad308 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.570344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 857/1695] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.571231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.574647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.575840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.576149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.576455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.593796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c34037-2723-4f73-8b72-d4156cbd7153 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.605558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.610005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:43.620017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.620593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.621163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.621163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.649361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.651765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 839/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:43.654091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.657447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:43.672961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ac0ed-032f-4767-abac-ea2e2e29a577 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.678487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 858/1697] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:43.679627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.682815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.683442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.683720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.691167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.693147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055871f8-0394-44ec-97f8-2fbfd61b26c4 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.698904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.699782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.700413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.700836 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.701666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:43.701974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.703627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:43.723367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 859/1698] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:43.735608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.739173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.740968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79e3b3-905c-4983-bd4c-04ce910e7dfd service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:43.758814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 840/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:43.760117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.760399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.760594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7dbaa-5d32-4c8f-b311-618cd997ece5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.760719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.766966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.770988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.770988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.771225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.771860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.773755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:43.842996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 860/1700] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:43.848297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:43.855520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] MFA Rules not processed for user `077cb54664e6457dbd31dae1708e8639`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:43.857391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:43.948379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.993938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 841/1701] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:43.994743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9386-fb80-4c7a-9100-5625589ed879 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:43.994913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:43.995540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:43.995881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:43.996228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:43.997721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:43.999946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.003237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.004856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:44.034908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 861/1702] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:43 2022] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:44.038772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.073669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3504940-10c2-4a1a-84e3-054a19dc8e67 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.089203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.090175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.091232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.091720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.092578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.094775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.113434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 862/1703] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:44.117857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.127632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e6f3-a50e-4942-8c15-bc6a69bf098b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.130859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a15f5-34af-402f-96e5-f6664a86f654 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.134786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.135522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.135904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.136184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.137006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.137659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.137941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.138326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.138980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.140639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.145532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.147185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05070-d8ce-4a64-bed7-a09855d606b4 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.163040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 863/1705] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:44.167194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.174402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 842/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:24:44.186332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc889d10-546b-47ae-b495-ca3b3303a90f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.192600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.193618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.194147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.195028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] PATH_INFO: `/v3/projects/982ae9d769c047c59766842f4dce626a/users/0789258ba1e844f39d6caa8f10f7b84f/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.235568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982ae9d769c047c59766842f4dce626a, user_id=0789258ba1e844f39d6caa8f10f7b84f, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.243199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.277225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 864/1706] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:44 2022] PUT /identity/v3/projects/982ae9d769c047c59766842f4dce626a/users/0789258ba1e844f39d6caa8f10f7b84f/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:24:44.292780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.293117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.293443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.363826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.365968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:44.393295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] MFA Rules not processed for user `0789258ba1e844f39d6caa8f10f7b84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:44.395052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:44.469595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:44.542613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 843/1707] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:44.547579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.580706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d95f-77eb-4ec4-afcf-c0f0fa1d6c20 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.592064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.592787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.593071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.594952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] PATH_INFO: `/v3/projects/236c1ca7807c45bd9d2076572ba3500b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.598742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=236c1ca7807c45bd9d2076572ba3500b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.604107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.692852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4e7d-4278-45dd-b910-0d0c7aada578 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.709368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.711296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.712842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.713901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.716107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.721742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:44.765347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236c1ca7807c45bd9d2076572ba3500b', 'request_id': 'req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:44.785677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236c1ca7807c45bd9d2076572ba3500b', 'request_id': 'req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:44.797462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 844/1708] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:44 2022] POST /identity/v3/projects => generated 397 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:24:44.802154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.806401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:44.818980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236c1ca7807c45bd9d2076572ba3500b', 'request_id': 'req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:44.865498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] The token cache is being invalidate because project 236c1ca7807c45bd9d2076572ba3500b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:44.867669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:44.869903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:44.881469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 865/1709] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:44 2022] DELETE /identity/v3/projects/236c1ca7807c45bd9d2076572ba3500b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:44.883103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:44.891850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:44.917403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:44.945182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a76d5d-b9a1-4b0c-ab9d-92df3c03efe0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:44.952177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:44.953286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:44.953574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:44.953949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] PATH_INFO: `/v3/projects/852df70b8649483089938d992dfd5124` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:44.955435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852df70b8649483089938d992dfd5124)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:44.957270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.057534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852df70b8649483089938d992dfd5124', 'request_id': 'req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.060712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b974b-50e5-4a43-a40d-0cf994dc6abe admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.077047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852df70b8649483089938d992dfd5124', 'request_id': 'req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.078757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:45.098754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852df70b8649483089938d992dfd5124', 'request_id': 'req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.121263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] The token cache is being invalidate because project 852df70b8649483089938d992dfd5124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:45.125682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.127835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.133217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 845/1710] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:44 2022] DELETE /identity/v3/projects/852df70b8649483089938d992dfd5124 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:45.133217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.134710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:45.183196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.185439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.185890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.186350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.187437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.191022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5119c7-2adf-4740-beca-b10c8be38145 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.276962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 866/1711] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:44 2022] POST /identity/v3/users => generated 305 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:45.281607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.282198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.282198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.298473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa671e3-2b41-40f1-bad3-f8e61c91efa2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.303418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.304569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.305264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.305937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] PATH_INFO: `/v3/users/19f27b982a9d4f659f6a0231dddf0d11` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.307507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f27b982a9d4f659f6a0231dddf0d11)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.310352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.334176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:45.335459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:45.377590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 867/1712] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:45.378629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.381428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:45.409223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12013-d3d8-4ec1-9fee-e0b696f11b16 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.428371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.429213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.429489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.429767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.430471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.432062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc277c-8518-4a7c-b37a-e04ba56420ef admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.478945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f27b982a9d4f659f6a0231dddf0d11'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.481155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f27b982a9d4f659f6a0231dddf0d11'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.481807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f27b982a9d4f659f6a0231dddf0d11'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.481929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 868/1713] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:45.489648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.489940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.490272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.506906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f27b982a9d4f659f6a0231dddf0d11'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.553823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f27b982a9d4f659f6a0231dddf0d11'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:45.554625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:45.555874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:45.577868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 869/1714] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:45.579550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.581469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 846/1715] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:45 2022] DELETE /identity/v3/users/19f27b982a9d4f659f6a0231dddf0d11 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:45.582109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:45.582462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.612163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a8a8-f3e0-45de-8c3f-30fbda72740c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.740470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210ee1f-97b8-43fd-bf43-f3e80d986d0d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.744025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.744724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.745052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.745330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] PATH_INFO: `/v3/projects/adcc4d35cc3f452b836aade60372ab0e/users/b8a0acb6f31b49f49cf371ff421204fb/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.759691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.759804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.760007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.760276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.760933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:45.761236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.763547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.771992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:45.784251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcc4d35cc3f452b836aade60372ab0e, user_id=b8a0acb6f31b49f49cf371ff421204fb, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.787001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.805535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 847/1716] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:45.807924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.821764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 870/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:45 2022] PUT /identity/v3/projects/adcc4d35cc3f452b836aade60372ab0e/users/b8a0acb6f31b49f49cf371ff421204fb/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:45.822753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:45.834333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa0f8-21a7-40b1-a5f4-af0477e28856 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.842799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:45.964517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c807-832a-4697-a7f9-00cf279bdd56 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:45.984348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.984985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.985268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.985543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.986245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:45.988310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:45.996331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:45.997988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:45.998144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:45.998460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:45.999109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:46.001051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:46.020374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 871/1718] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:46.034278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:46.045311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:46.077269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8790e7-1b5d-49c9-b59d-dfbbecfd2a48 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:46.083580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 848/1719] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:45 2022] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:46.083580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:46.242283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d23e30-2819-425c-a28f-78410f4b4119 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:46.253226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:46.255155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.256189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.258613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] PATH_INFO: `/v3/projects/adcc4d35cc3f452b836aade60372ab0e/users/b8a0acb6f31b49f49cf371ff421204fb/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.263765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcc4d35cc3f452b836aade60372ab0e, user_id=b8a0acb6f31b49f49cf371ff421204fb, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:46.266654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:46.292166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:46.292834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.293118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.293959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] PATH_INFO: `/v3/projects/1f91b72440db47abb08aa95c4ddcf4a0` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.298529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f91b72440db47abb08aa95c4ddcf4a0)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:46.300688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:46.314765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 849/1720] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:46 2022] PUT /identity/v3/projects/adcc4d35cc3f452b836aade60372ab0e/users/b8a0acb6f31b49f49cf371ff421204fb/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:46.316103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:46.426730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f91b72440db47abb08aa95c4ddcf4a0', 'request_id': 'req-16328491-b817-4ecd-9953-0d9251cbd99c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:46.437064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f91b72440db47abb08aa95c4ddcf4a0', 'request_id': 'req-16328491-b817-4ecd-9953-0d9251cbd99c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:46.459569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f91b72440db47abb08aa95c4ddcf4a0', 'request_id': 'req-16328491-b817-4ecd-9953-0d9251cbd99c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:46.493499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] The token cache is being invalidate because project 1f91b72440db47abb08aa95c4ddcf4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:46.493826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:46.496443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16328491-b817-4ecd-9953-0d9251cbd99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:46.500786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 872/1721] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:46 2022] DELETE /identity/v3/projects/1f91b72440db47abb08aa95c4ddcf4a0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:46.503857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590b038-5a55-4e83-bf68-1a09eba54dbf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.504163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590b038-5a55-4e83-bf68-1a09eba54dbf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.504633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590b038-5a55-4e83-bf68-1a09eba54dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.524207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb496627-e15e-404f-9019-4e9dbe104023 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:46.565995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:46.582049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3590b038-5a55-4e83-bf68-1a09eba54dbf None None] MFA Rules not processed for user `b8a0acb6f31b49f49cf371ff421204fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:46.583347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3590b038-5a55-4e83-bf68-1a09eba54dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:46.658640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:46.659982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.660268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.662749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.663462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:46.668175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:46.724541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:46.733902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 850/1722] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:46 2022] POST /identity/v3/users => generated 291 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:46.735080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:46.748799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:46.895762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 873/1723] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:46.896962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.897247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.897518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.965534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8c810-ab36-4233-a192-ee410593d22c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:46.970720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:46.970894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:46.987544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:46.988293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:46.988694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:46.989070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:46.995245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.003353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 874/1724] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:47.011205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.012620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.024588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.026498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.027722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2628c9-e412-4b80-826f-d668b9f093cf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.035664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.036280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.036636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.036980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] PATH_INFO: `/v3/projects/a262a7daaef840b1985b3f0601cd9a1e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.038723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a262a7daaef840b1985b3f0601cd9a1e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.041875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.055998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 851/1725] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:47.073117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.083377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.121518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b65317-f126-4c5a-8dc9-4a0546c3b8a1 service placement] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.126722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a262a7daaef840b1985b3f0601cd9a1e', 'request_id': 'req-ab098092-75b6-46cb-b3fc-61f91bb781f2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.142974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a262a7daaef840b1985b3f0601cd9a1e', 'request_id': 'req-ab098092-75b6-46cb-b3fc-61f91bb781f2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.157063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a262a7daaef840b1985b3f0601cd9a1e', 'request_id': 'req-ab098092-75b6-46cb-b3fc-61f91bb781f2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.201654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] The token cache is being invalidate because project a262a7daaef840b1985b3f0601cd9a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:47.201978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.206090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.211120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 875/1726] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:47 2022] DELETE /identity/v3/projects/a262a7daaef840b1985b3f0601cd9a1e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:47.211120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.211719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.295587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.297544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.298823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.299109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.300852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.306876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad618-188c-41f9-8ff3-e14622ee7a13 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.351932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 852/1727] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:47.357203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.357508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.357790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.379977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098092-75b6-46cb-b3fc-61f91bb781f2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.394326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.395732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.395732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.395732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.397570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.423346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:47.429628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.469884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 853/1728] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:47.473078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.483395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.509161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:47.545032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.546540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.547935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57ab6e-9458-4adc-ae77-405b0237a498 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.556556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.557649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.558087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.558541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] PATH_INFO: `/v3/users/7b429ee502d7463dae4de2ae02c254a3` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.560791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b429ee502d7463dae4de2ae02c254a3)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.564754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.567309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 876/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:47.570144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.575785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.609813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c5a41-de79-42e8-8efe-f57161fc51f6 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.625091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.625737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.626102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.626414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.627097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.628859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.671899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 877/1730] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:47.671899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.704557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f0db-edc3-43f5-95a2-c4dcb3e46524 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.719674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.720338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.720622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.720893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.721553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:47.721857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.723774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.766561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 878/1731] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:47.767476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:47.776707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:47.799386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:47.810790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8fcc7-6819-4094-9593-17702e8c132e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:47.825445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:47.826902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.827327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.827726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] PATH_INFO: `/v3/projects/87456e3f31594eb6a36d447353f88a96` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.833902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87456e3f31594eb6a36d447353f88a96)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:47.836327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:47.870765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b429ee502d7463dae4de2ae02c254a3'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.875247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b429ee502d7463dae4de2ae02c254a3'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.877879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b429ee502d7463dae4de2ae02c254a3'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.901483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b429ee502d7463dae4de2ae02c254a3'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.936080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a6f903ed-5907-4038-957d-6d954c153fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b429ee502d7463dae4de2ae02c254a3'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.959565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87456e3f31594eb6a36d447353f88a96', 'request_id': 'req-24bc040c-e700-4ba7-8a44-09fba55b2318'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:47.968024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 854/1732] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:47 2022] DELETE /identity/v3/users/7b429ee502d7463dae4de2ae02c254a3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:47.970417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:47.970784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:47.971128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:47.999883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] MFA Rules not processed for user `91786707d68f4a18a35031db85066d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:48.002036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.019401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87456e3f31594eb6a36d447353f88a96', 'request_id': 'req-24bc040c-e700-4ba7-8a44-09fba55b2318'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.039101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87456e3f31594eb6a36d447353f88a96', 'request_id': 'req-24bc040c-e700-4ba7-8a44-09fba55b2318'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.065894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] The token cache is being invalidate because project 87456e3f31594eb6a36d447353f88a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:48.066397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.069899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.072008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 879/1733] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:47 2022] DELETE /identity/v3/projects/87456e3f31594eb6a36d447353f88a96 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:48.072943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:48.074457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.115409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 855/1734] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:48.117575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:48.141548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.226315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc040c-e700-4ba7-8a44-09fba55b2318 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:48.289414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:48.316006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:48.317026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.318513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.318911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] PATH_INFO: `/v3/projects/acc64eddbd634200a389cce92f075a10/users/d06f2f818f2f4cd5808eda4503dfdc0b/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.359415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc64eddbd634200a389cce92f075a10, user_id=d06f2f818f2f4cd5808eda4503dfdc0b, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:48.362618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:48.402301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 880/1735] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:48 2022] PUT /identity/v3/projects/acc64eddbd634200a389cce92f075a10/users/d06f2f818f2f4cd5808eda4503dfdc0b/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:48.407560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:48.409924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf9fc2-256f-4a2b-9a38-01ec6b98fe7f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:48.414110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.533166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f7690-22bc-4c3a-93a1-9aba901eb830 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:48.557778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:48.560031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.560760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.561386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] PATH_INFO: `/v3/users/0789258ba1e844f39d6caa8f10f7b84f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.564768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0789258ba1e844f39d6caa8f10f7b84f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:48.570230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:48.570437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:48.587530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:48.588277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.588801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.597033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.598970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:48.636150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9ec3e-e15a-4bae-81fb-87a57d28c437 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:48.695821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 856/1736] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:48 2022] POST /identity/v3/projects => generated 353 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:48.696261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714358-5f61-4c62-8782-741474b2999b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.696411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714358-5f61-4c62-8782-741474b2999b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.696747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714358-5f61-4c62-8782-741474b2999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.721707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0789258ba1e844f39d6caa8f10f7b84f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.723906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0789258ba1e844f39d6caa8f10f7b84f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.742173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0789258ba1e844f39d6caa8f10f7b84f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.743181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-73714358-5f61-4c62-8782-741474b2999b None None] MFA Rules not processed for user `077cb54664e6457dbd31dae1708e8639`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:48.747807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-73714358-5f61-4c62-8782-741474b2999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.777003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0789258ba1e844f39d6caa8f10f7b84f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.786090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6fe65bc7-cc50-41e6-a376-d57e8c2487b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0789258ba1e844f39d6caa8f10f7b84f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:48.800793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 881/1737] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:48 2022] DELETE /identity/v3/users/0789258ba1e844f39d6caa8f10f7b84f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:48.803795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.804220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.804942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.857873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:48.859395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:48.893536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 857/1738] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:48.896933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:48.897214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:48.897495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:48.972089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] MFA Rules not processed for user `d06f2f818f2f4cd5808eda4503dfdc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:48.973379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.008046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:49.041140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 882/1739] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.047391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.048963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.080569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da68a86-c7ce-41fd-bd9f-d04a0c8a4c84 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.096371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.097817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.098300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.098714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.099508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.102668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9b1b9-3638-4064-8c7a-6a52727f279e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.130274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 858/1740] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.130274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.147969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.162044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 883/1741] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/users => generated 277 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:49.163667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed44d9-d081-4afa-bafd-14447661e4c0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.164135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed44d9-d081-4afa-bafd-14447661e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.164717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed44d9-d081-4afa-bafd-14447661e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.189051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214c4aa-ab03-487b-9bee-64604b4358d6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.197673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c1ed44d9-d081-4afa-bafd-14447661e4c0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:49.199286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c1ed44d9-d081-4afa-bafd-14447661e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.203271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.204077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.204363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.204632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] PATH_INFO: `/v3/projects/6bf18f42ef484ed78fb9dc5708b75245` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.209417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf18f42ef484ed78fb9dc5708b75245)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.210647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 884/1742] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.212234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.212805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.214608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.217183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.258737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:49.260268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.274996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 885/1743] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.274996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.274996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.291076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf17cf-c79b-488c-a6e3-eef93b232bad None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.310254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.313898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.314192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.314499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.319637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.325315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.368080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf18f42ef484ed78fb9dc5708b75245', 'request_id': 'req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:49.400811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 886/1744] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:49.401959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.404638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf18f42ef484ed78fb9dc5708b75245', 'request_id': 'req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:49.432340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf18f42ef484ed78fb9dc5708b75245', 'request_id': 'req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:49.448048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:49.481931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] The token cache is being invalidate because project 6bf18f42ef484ed78fb9dc5708b75245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:49.482500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:49.484346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:49.490811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 859/1745] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:49 2022] DELETE /identity/v3/projects/6bf18f42ef484ed78fb9dc5708b75245 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:49.492349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.502097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.549042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623610a-9d9c-43d3-937f-0586c3edf4dd admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.553989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.554723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.555099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.555655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.556415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.558099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ea30-a95a-41f5-bc7d-9415fba96691 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.572573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 887/1746] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:49.574148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.574533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.575596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.577636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 888/1747] 10.222.0.42 () {54 vars in 912 bytes} [Fri Sep 9 13:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:49.578353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.582502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.603010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8c3d-fd2d-4883-8af6-c7c93f5c4865 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.609296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.609932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.610838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.611118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.611775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:49.612083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.614686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.632211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 889/1748] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:49.633947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a5bb7-b6ba-4d6a-81b5-c9b5b3275999 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.636972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.639703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.654578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56e1e9-3539-4bf5-9bd0-4c184191bd01 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.660085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.660710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.660984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.661258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.661899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.663992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6aef1-4de8-40c4-82de-d2a30056757f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.690840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 890/1749] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/users => generated 296 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:49.692450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.692736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.693011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.720844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:49.721855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.724734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.725394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.725676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.726046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.728128 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.737179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 891/1750] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.738155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.739782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.743052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.744589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c930372-9243-48b1-9b31-52a78bcf31f3 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.755988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599b137-90bf-47b9-8cb4-b92c2c473359 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.757480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 860/1751] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:49.759075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.759364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.759637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.770005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.770649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.770929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.771203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.771866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.773850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.792631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 892/1752] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:49.792631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.799942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:49.803124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.808337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969643b-f44c-4522-bd85-05ac4d8142a8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.827597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.828410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.828544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 861/1753] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:49.828867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.829238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.829651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.830278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.835053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a9e19-ca5c-4a21-b237-77db91c9904c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.863289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaf90b-5012-4461-b1a9-089902c5c08c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.869946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:49.870848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.871249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.871598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.873074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:49.875673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:49.887294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 893/1754] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:49.889613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:49.889784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:49.890168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:49.920012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 862/1755] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:49.921523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:49.924930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:49.926569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:49.949080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c17fe7-0176-49e6-b9e1-fda1937e2cdc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:49.977960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:50.118659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 894/1756] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:50.119641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.123716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:50.137410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.138308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.139021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.139199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] PATH_INFO: `/v3/projects/b7b970e6ecc7403b9a284aa204af426d/users/8475ef940d164a44a4eefcb8249737e5/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.195887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b970e6ecc7403b9a284aa204af426d, user_id=8475ef940d164a44a4eefcb8249737e5, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.217662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.281934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 863/1757] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:49 2022] PUT /identity/v3/projects/b7b970e6ecc7403b9a284aa204af426d/users/8475ef940d164a44a4eefcb8249737e5/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:50.282969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.368463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:50.407405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8d6ab-14bb-4232-80f8-11ccee105ee3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.480007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94993c6e-1f88-4a5e-b40a-0b579f8e185a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.515073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.515962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.516393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.516813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.520733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.523836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.565692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.566978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.568233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.568622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.597236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.597837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 864/1758] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:50 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:50.599674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.601195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.616418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 895/1759] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:50.618623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.620917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b200a7b-1985-4a0e-afc3-4174f8df3f5e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.633284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2a8ee-113b-47fe-b40d-e62afcce20f7 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.634087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.635354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.635782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.636203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] PATH_INFO: `/v3/projects/939b1fd9d56c44a29705d1603ead4575/users/fba761b706444199aca2b2be0b524177/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.640441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.641215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.641601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.641981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.642850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:50.643264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.645367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c964b7-3633-425d-a4b2-237572a9be70 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.662125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 896/1760] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:50.664200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.664599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.664980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.679253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] RBAC: Authorizing `identity:create_grant(project_id=939b1fd9d56c44a29705d1603ead4575, user_id=fba761b706444199aca2b2be0b524177, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.683967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.713101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] MFA Rules not processed for user `8475ef940d164a44a4eefcb8249737e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:50.714901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:50.715931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 865/1761] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:50 2022] PUT /identity/v3/projects/939b1fd9d56c44a29705d1603ead4575/users/fba761b706444199aca2b2be0b524177/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:50.716927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.719738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:50.838376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 897/1762] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:50.843953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:50.854333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:50.859956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7125a4-a83f-463d-8a88-679eb27a725a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.869194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67133a56-5d20-477f-9c51-0dceaa09041a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:50.876750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.879370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.879540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.879894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] PATH_INFO: `/v3/projects/982ae9d769c047c59766842f4dce626a` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.881261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982ae9d769c047c59766842f4dce626a)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.883977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.895513 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:50.897496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.897621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.898493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.901428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:50.904555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab16080-0ac8-400e-bfc9-5645c6abb324 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:50.920152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 898/1763] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:50.921888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:50.922374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:50.922775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:50.951952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982ae9d769c047c59766842f4dce626a', 'request_id': 'req-19648cb7-e6a8-45b7-a348-72a04cb721b5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:50.961283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982ae9d769c047c59766842f4dce626a', 'request_id': 'req-19648cb7-e6a8-45b7-a348-72a04cb721b5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:50.970145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982ae9d769c047c59766842f4dce626a', 'request_id': 'req-19648cb7-e6a8-45b7-a348-72a04cb721b5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.001683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] The token cache is being invalidate because project 982ae9d769c047c59766842f4dce626a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:51.002129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.003181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.005295 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 866/1764] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:50 2022] DELETE /identity/v3/projects/982ae9d769c047c59766842f4dce626a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:51.006336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.009345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.022671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:51.024113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.041376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:51.117893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 899/1765] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:24:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:51.126521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.127876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.181792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648cb7-e6a8-45b7-a348-72a04cb721b5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.199143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.199912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.201678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.202039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.204638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.206706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.279876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 867/1766] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:51 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:51.280900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.282825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fc8a-86a0-40f9-b7c8-1d1db4a215bd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.283285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.397131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.398746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.400011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.400443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.401143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e4119-100b-40f4-953d-81664098d2b7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.402490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.404907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.408292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.409030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.409412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.409830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.411026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.412684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.424508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 900/1767] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:51.425759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.428352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.447921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83da3e5-2090-485f-b4e8-3703f6071133 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.449380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 868/1768] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:51 2022] POST /identity/v3/projects => generated 355 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:51.451693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.453595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.457192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:51.560060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.560859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.561146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.561408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.562240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.566854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349ea55-c59a-4b38-a848-2b32a6c6927e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.569033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.573386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.574290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.574778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.575347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] PATH_INFO: `/v3/users/b8a0acb6f31b49f49cf371ff421204fb` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.576720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a0acb6f31b49f49cf371ff421204fb)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.578945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.584467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 901/1769] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:51.585534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.600918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cac45-d7c4-4173-b3ca-472c8f166037 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.607632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:51.609172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:51.609800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:51.610328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:51.611339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:51.614826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:51.637943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:51.651112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 902/1770] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:51 2022] POST /identity/v3/users => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:51.652363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.655419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.685004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a0acb6f31b49f49cf371ff421204fb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.686184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a0acb6f31b49f49cf371ff421204fb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.686922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a0acb6f31b49f49cf371ff421204fb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.696974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a0acb6f31b49f49cf371ff421204fb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.757070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a0acb6f31b49f49cf371ff421204fb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:51.778744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 869/1771] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:51 2022] DELETE /identity/v3/users/b8a0acb6f31b49f49cf371ff421204fb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:51.779996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:51.781718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:51.915715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0a7f-0150-4b55-b6db-a643e0f3a338 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:51.992250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02352ed-6a3d-4bac-bb4a-9f0fc531489d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.011844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.013357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.013648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.016540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] PATH_INFO: `/v3/projects/939b1fd9d56c44a29705d1603ead4575/users/fba761b706444199aca2b2be0b524177/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.024172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=939b1fd9d56c44a29705d1603ead4575, user_id=fba761b706444199aca2b2be0b524177, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.030480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.060667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 870/1772] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:51 2022] PUT /identity/v3/projects/939b1fd9d56c44a29705d1603ead4575/users/fba761b706444199aca2b2be0b524177/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:52.063935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:52.068659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.078841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.082937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.083216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.083497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.093024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.131356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:52.192893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474be4-a38a-4be8-b875-1ca6de0ea0db admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.199208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.200466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.200937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.204274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.205983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.209901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.238305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.240100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.251590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 871/1773] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:52 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:52.251852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 903/1774] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:24:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:24:52.253213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:52.253619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:52.254806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.255911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.274154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee830db-e68d-491e-a672-da3f236fadd9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.295988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.296568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabecea-1e8f-4393-8169-cfa9bb1d7646 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.297586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.298241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.298631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] PATH_INFO: `/v3/projects/d6069902522c4a2893cd674fa0db1935/users/bb0cc912663a40a5bd72831e450a55c2/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.321644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.322305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6069902522c4a2893cd674fa0db1935, user_id=bb0cc912663a40a5bd72831e450a55c2, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.322467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.322752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.323030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.328207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc85d0-8105-46e7-8b81-5024fe8e4314 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.329987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.332233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.371804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 872/1775] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:52 2022] PUT /identity/v3/projects/d6069902522c4a2893cd674fa0db1935/users/bb0cc912663a40a5bd72831e450a55c2/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:52.371804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5841-1c86-450e-abc0-615a0cff1502 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.371804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5841-1c86-450e-abc0-615a0cff1502 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.371804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5841-1c86-450e-abc0-615a0cff1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.401256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 904/1776] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:52.401256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:52.414159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96962fa-524e-45cc-a4b5-a40577b25503 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.445689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:52.485274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c8fc5841-1c86-450e-abc0-615a0cff1502 None None] MFA Rules not processed for user `fba761b706444199aca2b2be0b524177`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:52.486777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c8fc5841-1c86-450e-abc0-615a0cff1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.605703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.609468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.610489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.611015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.612149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.614443 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.650308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 905/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:52.651583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:52.659977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.707326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bdae-6d56-4afe-b040-c1c8477e36dc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:52.732487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 873/1778] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:52.745361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:52.746036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.746143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:52.746737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.747223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.751299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:52.751643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] PATH_INFO: `/v3/projects/adcc4d35cc3f452b836aade60372ab0e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:52.758831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcc4d35cc3f452b836aade60372ab0e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:52.761971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:52.825346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] MFA Rules not processed for user `bb0cc912663a40a5bd72831e450a55c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:52.826902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:52.956910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcc4d35cc3f452b836aade60372ab0e', 'request_id': 'req-383064bf-3362-44e0-a14a-be8e3ffafc67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:52.971749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcc4d35cc3f452b836aade60372ab0e', 'request_id': 'req-383064bf-3362-44e0-a14a-be8e3ffafc67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:52.987797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 874/1779] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:52.992882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcc4d35cc3f452b836aade60372ab0e', 'request_id': 'req-383064bf-3362-44e0-a14a-be8e3ffafc67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:52.993114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.017267 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9379d-a35c-4b16-a46a-6c4806303814 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.061197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] The token cache is being invalidate because project adcc4d35cc3f452b836aade60372ab0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:24:53.061499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:53.066581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:53.079769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 906/1780] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:24:52 2022] DELETE /identity/v3/projects/adcc4d35cc3f452b836aade60372ab0e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:53.079769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.084699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.164780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.165681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.166030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.166424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.167154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:53.171449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:53.178958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:53.187304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 875/1781] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:53.188448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.191574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.247990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:53.336823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383064bf-3362-44e0-a14a-be8e3ffafc67 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.348271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.349271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.349658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.350408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] PATH_INFO: `/v3/projects/16a60c478cec4f14910d6c18c861437e/users/a964425f4d54488b875d171d337c9e13/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.384945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a60c478cec4f14910d6c18c861437e, user_id=a964425f4d54488b875d171d337c9e13, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:53.394000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed23239-703a-419b-871d-c4b4f7c7d38e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:53.429064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 907/1782] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:53 2022] PUT /identity/v3/projects/16a60c478cec4f14910d6c18c861437e/users/a964425f4d54488b875d171d337c9e13/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:53.431823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.432115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.432677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.468369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d66c-30aa-4c1d-8f2f-4cd5762b31c7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.478574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:53.479814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.587231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.587782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 908/1783] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 9 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:53.587919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.588373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.589077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.603592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.603975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.608249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.688872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:53.690803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2aeb-b285-4ffc-950a-04d7431496c1 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:53.691225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dfe10-6c68-42de-9019-5def35db6d86 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.698365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.699120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.699540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.700417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.701282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:53.704081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:53.705735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 876/1784] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:53.707492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.708025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.708707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.745647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:53.747030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.758120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 877/1785] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:53.759190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.760557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:53.772911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 909/1786] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:53 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:53.772911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:53.799694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042d3c7-6760-4d2f-8180-e10e53ae3037 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.894491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:53.937387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68af58-1e76-46d1-9b88-09b6f03d80fa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:53.948061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.948781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.949134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.949487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.950774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:53.952519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38cecb-01d1-40d1-a163-f637fff7652d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:53.982710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 910/1787] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:53.984218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.984580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.984932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:53.985490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:53.986981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:53.987730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:53.988715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] PATH_INFO: `/v3/projects/e79ac16b681e41f0b39df604bf61026d/users/677450a65fef4513849d62c956dff7fc/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.021793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:54.023359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:54.032816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 911/1788] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:54.033754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.036812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79ac16b681e41f0b39df604bf61026d, user_id=677450a65fef4513849d62c956dff7fc, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.039559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.045935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24524e-2ea4-4bcd-b18c-c00e6927728b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.052797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.053322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.053655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.053983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.054604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.056949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.059887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:54.070190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 878/1789] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:53 2022] PUT /identity/v3/projects/e79ac16b681e41f0b39df604bf61026d/users/677450a65fef4513849d62c956dff7fc/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:54.072444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.126049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 912/1790] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:54 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:54.126049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.155548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a137-5f29-4c41-b686-347ea5eb28d9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.221454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fb18-922d-4d60-a2c2-6045e1ee6be4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.225987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.226806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.227212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.233169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.235570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:54.254480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.255578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.256255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.256633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] PATH_INFO: `/v3/projects/16a60c478cec4f14910d6c18c861437e/users/a964425f4d54488b875d171d337c9e13/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.259154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a60c478cec4f14910d6c18c861437e, user_id=a964425f4d54488b875d171d337c9e13, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.262230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.291504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 913/1791] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:54 2022] PUT /identity/v3/projects/16a60c478cec4f14910d6c18c861437e/users/a964425f4d54488b875d171d337c9e13/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:54.292458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.351910 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.353844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10bfd-f6ce-402c-b829-819b5bea9c94 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.370835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 879/1792] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:54.373398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.373875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.374506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.406114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2e7b0-520f-4040-b6e8-ff8b88c3107e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.412331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.413520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.413903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.414319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.415112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:24:54.415523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.417599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.436979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 914/1793] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:24:54.438019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] MFA Rules not processed for user `677450a65fef4513849d62c956dff7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:54.438281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.441487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:54.452086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db12df3-1a02-41a4-a1c3-2179fc4b8370 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.461512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.462358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.462745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.463120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.464666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.467307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb17f58-032b-4805-b623-37f4142eb56f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.511545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 915/1794] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:54.514056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.515358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.515832 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.625312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] MFA Rules not processed for user `a964425f4d54488b875d171d337c9e13`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:54.626885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:54.659607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:54.662644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 880/1795] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:54.663846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.677438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c347b1-5c27-4e6d-854e-7914f1131ac8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.695533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.698724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.698724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.698938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.702754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:54.704725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:54.804244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 881/1796] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:54 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:54.804244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.807376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 916/1797] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:54.808876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:54.839396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587504c7-7f25-4f76-b4a2-f9ea26ffd217 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.862774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:54.985016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04079b8-bd49-486a-a5b7-e151cbd08136 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:54.993091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.994259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.994807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.995153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] PATH_INFO: `/v3/projects/e599465cb53b4a3aa55bed19fda02230/users/5eb668ed216c4cb19b7c136b05909a4f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.996028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:54.996761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:54.997047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:54.997975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:54.997975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.007256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.014479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e599465cb53b4a3aa55bed19fda02230, user_id=5eb668ed216c4cb19b7c136b05909a4f, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.018034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.046705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 882/1798] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:54 2022] PUT /identity/v3/projects/e599465cb53b4a3aa55bed19fda02230/users/5eb668ed216c4cb19b7c136b05909a4f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:55.048548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.082426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 917/1799] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:54 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:55.083444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.149505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c042d-8800-49bd-8df7-2616fa864650 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.178036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846e71-e951-4037-bb0b-0bec006e8350 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.183356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.185324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.185671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.185946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.227105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.227973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.228268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.228663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.229312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.232797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.265873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 883/1800] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:55 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:55.266806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.272061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:55.275220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:55.310544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.312501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.327376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 918/1801] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:55.340357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.341469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:55.359710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd72536-a56a-4d7b-b290-fbecc5268eeb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.364301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.365180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.365651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.366378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.367070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb1fbe-ca90-40ab-ba8b-1d67d25cb55c service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.391698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.393167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.395088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085e98-5495-448d-8814-6f146431952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.395732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085e98-5495-448d-8814-6f146431952f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.396015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085e98-5495-448d-8814-6f146431952f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.396291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37085e98-5495-448d-8814-6f146431952f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.397533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37085e98-5495-448d-8814-6f146431952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.399992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37085e98-5495-448d-8814-6f146431952f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.409495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 884/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:55.410382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.412325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 919/1803] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:55.413255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085e98-5495-448d-8814-6f146431952f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.433262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37085e98-5495-448d-8814-6f146431952f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.441136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523cce-d6ef-4718-99ce-7e428dfcc2b2 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.446535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.447166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.447449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.447718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.448379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.451987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.455916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.456591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.456875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.457146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.457797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.463398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.474674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 920/1804] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:55.475608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.494901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c634fb-b4da-47d9-b30e-7e43b06982d6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.516974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.517667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.517944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.518239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] PATH_INFO: `/v3/projects/e599465cb53b4a3aa55bed19fda02230/users/5eb668ed216c4cb19b7c136b05909a4f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.520221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e599465cb53b4a3aa55bed19fda02230, user_id=5eb668ed216c4cb19b7c136b05909a4f, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.522970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.535174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 885/1805] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:55 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:55.538344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.553347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb5db2-7e07-4935-ae9a-504781161eeb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.553875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 921/1806] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:55 2022] PUT /identity/v3/projects/e599465cb53b4a3aa55bed19fda02230/users/5eb668ed216c4cb19b7c136b05909a4f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:55.555355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.724355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1abb-0b5c-4959-8890-7f5ab02ac9ed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.735157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.736830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.737121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.737398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.744086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:55.751364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.752379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.752811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.753211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.754972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.757567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.783866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 886/1807] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:55.787258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:55.810872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f91a2-fdc7-4a98-a225-52a1633d92ae admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:55.824137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:55.825279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.854982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.855323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.856147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:55.864391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1139d-eb57-4f3e-bf69-584cb481731f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:55.901549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 887/1808] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:55.905550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:55.905550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:55.905826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:55.994279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] MFA Rules not processed for user `5eb668ed216c4cb19b7c136b05909a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:55.995514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:56.018948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:56.023358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:56.043994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 922/1809] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:56.044937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:56.069355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595dea-2b76-42d1-8c4f-6f0bc404488f service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:56.082915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:56.083781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:56.084215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:56.084590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] PATH_INFO: `/v3/projects/4623174162374387be549d7c0b36fdfe/users/788710a23812437592b30b0cac5c4642/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:56.140914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4623174162374387be549d7c0b36fdfe, user_id=788710a23812437592b30b0cac5c4642, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:56.165047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f0b1-f1bd-4f6b-a26b-c480af6d3d4c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:56.204139 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 923/1810] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:56 2022] PUT /identity/v3/projects/4623174162374387be549d7c0b36fdfe/users/788710a23812437592b30b0cac5c4642/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:56.204259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 888/1811] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:56.205147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:56.216589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:56.217166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:56.217666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:56.231943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97d808-fddf-4db8-86de-dc6aa347a6a0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:56.305747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] MFA Rules not processed for user `788710a23812437592b30b0cac5c4642`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:56.308311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:56.321440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:56.400326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:56.400952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:56.401521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:56.401839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:56.405115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:56.407423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:56.407924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:56.450441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 889/1812] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:56.451837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:56.561477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 924/1813] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:56.562608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:56.585365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa21a-9515-4fd3-b488-6b79fa895342 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:56.593973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:56.594276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:56.595031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:56.595031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] PATH_INFO: `/v3/projects/0b8a7b63a5f8494a819857ca00db8a8d/users/a8e4ae1affea4ed08e2b908a554911f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:56.619458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8a7b63a5f8494a819857ca00db8a8d, user_id=a8e4ae1affea4ed08e2b908a554911f8, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:56.624207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:56.656365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 925/1814] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:56 2022] PUT /identity/v3/projects/0b8a7b63a5f8494a819857ca00db8a8d/users/a8e4ae1affea4ed08e2b908a554911f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:56.657266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:56.679791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43f320-f379-4d8d-b1b1-91e32008c1c9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:56.952186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:56.952924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:56.953285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:56.953630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.029329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217afbff-5e25-4c04-b493-fde6b9d7ec00 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:57.062471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:57.063132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:57.073321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:57.073638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.074369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:57.112766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c12353-a64c-48c3-80da-41640a76d559 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:57.202766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 926/1815] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:56 2022] POST /identity/v3/projects => generated 379 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:57.203112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:57.205370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:57.205849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:57.206137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.214086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:57.251485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] MFA Rules not processed for user `a8e4ae1affea4ed08e2b908a554911f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:57.252959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:57.288847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 890/1816] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 833 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:57.290019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:57.331472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d38f-a72e-4259-9f14-9c62ad20e1ae service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:57.385613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 927/1817] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:57.388210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:57.444792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:57.489422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:57.520090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:57.520472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:57.521459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:57.521837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.522526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:57.525494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:57.586061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 891/1818] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:57 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:57.602241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:57.611661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ddbd2-1cfd-49c3-83c9-1de26d4edcfa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:57.625433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:57.628153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:57.628854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:57.630389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] PATH_INFO: `/v3/users/bb0cc912663a40a5bd72831e450a55c2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.632880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0cc912663a40a5bd72831e450a55c2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:57.638472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30e91-8e39-4866-a516-9e9d3d15d711 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:57.640964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:57.649039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:57.649733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:57.650017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:57.652444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:57.654300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:57.656474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:57.733582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 892/1819] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:24:57 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:57.737035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:57.810206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0cc912663a40a5bd72831e450a55c2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:57.811740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0cc912663a40a5bd72831e450a55c2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:57.832205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0cc912663a40a5bd72831e450a55c2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:57.862584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0cc912663a40a5bd72831e450a55c2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:57.897124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0cc912663a40a5bd72831e450a55c2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:24:57.921686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 928/1820] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:24:57 2022] DELETE /identity/v3/users/bb0cc912663a40a5bd72831e450a55c2 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:57.924585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:57.931082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:57.936121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f88b-7b93-4283-b693-693d3d9ae5fc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.082093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.083714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.084313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.084728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.085529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.087309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55552-2ed5-4460-8c9d-46dfe49e65ef admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.111002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 893/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:58.114400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.115182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.117249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.142964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680f391-af1e-4604-b5d6-2c03240d6073 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.161640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:58.162954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:58.183082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 894/1822] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:58.183853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.189462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:58.192879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.196699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.201733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.209527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.210504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.220831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f22e57-a1c0-4c42-bc4b-d9d9a34a7f2a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.233431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.236285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.237007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.237286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.237525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] PATH_INFO: `/v3/projects/1254287fde984bce95b195e8f52763e4/users/bec7feb817d4462aa3563deeef69f75a/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.273513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1254287fde984bce95b195e8f52763e4, user_id=bec7feb817d4462aa3563deeef69f75a, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.276752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.308185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 895/1823] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:58 2022] PUT /identity/v3/projects/1254287fde984bce95b195e8f52763e4/users/bec7feb817d4462aa3563deeef69f75a/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:58.308185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.310710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:58.319106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 929/1824] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:24:57 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:24:58.321633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.350124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5ac2d-adef-47dd-957a-49a3f5e41be6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.361979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:58.413901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:58.451024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e1deb-f101-4265-aa5d-9ba2bfdcca2c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.462625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.474335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.474599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.475520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.498352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.498990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.499270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.499540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.500702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.502502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.531096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 930/1825] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:58.531096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.565331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e127c-8696-4d42-a68b-79024350857b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.580267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.580897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.581181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.581456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.582105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.584757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.615984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 931/1826] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:58.617244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.640671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dced7-ddd0-432e-8320-5fb5c585e122 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.653014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.655823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.656207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.657216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.657571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.657894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] PATH_INFO: `/v3/projects/1254287fde984bce95b195e8f52763e4/users/bec7feb817d4462aa3563deeef69f75a/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.660883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1254287fde984bce95b195e8f52763e4, user_id=bec7feb817d4462aa3563deeef69f75a, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.668747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46d0e0-e9b8-41d8-8e4d-e71ebe02e8a2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.683414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 896/1827] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:58.684065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.713181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 932/1828] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:58 2022] PUT /identity/v3/projects/1254287fde984bce95b195e8f52763e4/users/bec7feb817d4462aa3563deeef69f75a/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:58.715223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.715633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.715950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.716919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac288f7-4675-4b6f-a795-14d919e2cd85 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.755048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] MFA Rules not processed for user `bec7feb817d4462aa3563deeef69f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:58.756634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:58.873138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:58.874138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:58.874596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:58.875044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] PATH_INFO: `/v3/projects/87a4c4acdd06478f87b8526e8d377f5e/users/845a147973ee482f84d5958ed23b7809/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:58.913314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 933/1829] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:58.913908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a4c4acdd06478f87b8526e8d377f5e, user_id=845a147973ee482f84d5958ed23b7809, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:58.919633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:58.969427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 897/1830] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:58 2022] PUT /identity/v3/projects/87a4c4acdd06478f87b8526e8d377f5e/users/845a147973ee482f84d5958ed23b7809/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:58.971499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.987376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:58.988266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36844f2-e6b7-4ad7-ab0a-a9be1f1979e8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:58.990077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:59.103389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57cf11-d1d4-49e4-a157-c604996e559f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:59.116330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:59.118082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.119030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.119469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.131934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:59.160855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:59.162829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.163352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.164128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.165031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:59.169535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:59.181533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 934/1831] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:24:59.187461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:59.213027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb56c-fc26-4b94-bc4e-f7f9c878c708 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:59.220217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:59.221325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.222023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.222843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] PATH_INFO: `/v3/projects/87a4c4acdd06478f87b8526e8d377f5e/users/845a147973ee482f84d5958ed23b7809/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.227262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a4c4acdd06478f87b8526e8d377f5e, user_id=845a147973ee482f84d5958ed23b7809, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:59.232017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1817e87-0161-44aa-9c2b-2d14b7ddae7f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:59.284935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 935/1832] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:24:59 2022] PUT /identity/v3/projects/87a4c4acdd06478f87b8526e8d377f5e/users/845a147973ee482f84d5958ed23b7809/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:24:59.287268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35710-b5d7-45be-86c7-de6ad63fa56c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.287560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35710-b5d7-45be-86c7-de6ad63fa56c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.287840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35710-b5d7-45be-86c7-de6ad63fa56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.294858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:59.298839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:59.316075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 898/1833] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:59.345746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:59.379193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-24b35710-b5d7-45be-86c7-de6ad63fa56c None None] MFA Rules not processed for user `845a147973ee482f84d5958ed23b7809`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:59.384233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-24b35710-b5d7-45be-86c7-de6ad63fa56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:59.541361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 936/1834] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:24:59.550046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:59.561186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5a2a-5b4d-4ab5-aac0-bf7fb5498fac service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:59.679630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:59.680254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.680535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.680807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.713495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:24:59.715350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff119-cee2-49e7-9669-161c7038cfa7 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:24:59.736864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 899/1835] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:24:59.779696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdd8-41b5-4cb6-b2a2-c5197ad5f0dc None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.779696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdd8-41b5-4cb6-b2a2-c5197ad5f0dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.779696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fdd8-41b5-4cb6-b2a2-c5197ad5f0dc None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.781902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 937/1836] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:24:59.798588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.798588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.798588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.819093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fdd8-41b5-4cb6-b2a2-c5197ad5f0dc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:24:59.848915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fdd8-41b5-4cb6-b2a2-c5197ad5f0dc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:24:59.855568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:24:59.856873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:24:59.857135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:24:59.857455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:24:59.866258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:24:59.898974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:24:59.900610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:00.018643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:00.021037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:00.033220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 938/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:24:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:00.197157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 900/1838] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:00.199337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:00.201534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:00.249992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:00.405320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:00.489452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2ef8c-d4a6-4776-9e9c-cec764a5668a service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:00.491926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3bc8e-626b-4a7f-b936-369b79a5d0c7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:00.503495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec7feb817d4462aa3563deeef69f75a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1254287fde984bce95b195e8f52763e4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:00.504294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:00.504460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:00.504691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:00.505364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:00.505684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:00.507345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:00.509507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:00.511054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:00.511358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:00.511611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] PATH_INFO: `/v3/projects/d6069902522c4a2893cd674fa0db1935` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:00.516522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6069902522c4a2893cd674fa0db1935)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:00.518836 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:00.563352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 901/1839] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:00.567050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:00.580809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:00.614260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9373-f797-4f79-b2ef-a4039a68bbf9 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:00.635531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:00.636225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:00.636516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:00.636795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:00.664940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:00.664940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50515009-0384-4c47-a1b8-c12c8b15b4d4 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:00.687631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 902/1840] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:00.690787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:00.701414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460172-4391-4907-a90b-ea6fa4c4d161 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:00.701754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460172-4391-4907-a90b-ea6fa4c4d161 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:00.701967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f460172-4391-4907-a90b-ea6fa4c4d161 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:00.711411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 903/1841] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:25:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:25:00.712335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f460172-4391-4907-a90b-ea6fa4c4d161 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:00.732934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6069902522c4a2893cd674fa0db1935', 'request_id': 'req-78cd5013-61a4-472a-89b8-0a3e19997130'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:00.750809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6069902522c4a2893cd674fa0db1935', 'request_id': 'req-78cd5013-61a4-472a-89b8-0a3e19997130'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:00.784974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6069902522c4a2893cd674fa0db1935', 'request_id': 'req-78cd5013-61a4-472a-89b8-0a3e19997130'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:00.823804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] The token cache is being invalidate because project d6069902522c4a2893cd674fa0db1935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:00.824113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:00.826381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:00.837836 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 939/1842] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:00 2022] DELETE /identity/v3/projects/d6069902522c4a2893cd674fa0db1935 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:00.838818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:00.849843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:01.021310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f460172-4391-4907-a90b-ea6fa4c4d161 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:01.039652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec7feb817d4462aa3563deeef69f75a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1254287fde984bce95b195e8f52763e4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:01.040291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.040580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.041029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.041688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:01.044350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1afed2-e80b-4f8d-ada1-636e03ba323e tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:01.056719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd5013-61a4-472a-89b8-0a3e19997130 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:01.071380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:01.071380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.071380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.071719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] PATH_INFO: `/v3/users/5eb668ed216c4cb19b7c136b05909a4f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.075021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb668ed216c4cb19b7c136b05909a4f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:01.077205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:01.208412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb668ed216c4cb19b7c136b05909a4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:01.210344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb668ed216c4cb19b7c136b05909a4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:01.220195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 904/1843] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:00 2022] POST /identity/v3/projects => generated 353 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:01.226943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb668ed216c4cb19b7c136b05909a4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:01.232823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.233259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.233627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.253303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb668ed216c4cb19b7c136b05909a4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:01.272798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb668ed216c4cb19b7c136b05909a4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:01.299115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 940/1844] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:00 2022] DELETE /identity/v3/users/5eb668ed216c4cb19b7c136b05909a4f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:01.300802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:01.303447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:01.321902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:01.330713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:01.365282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:01.447135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00d894-f424-4064-81ce-c1b1fc030cfb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:01.462286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec7feb817d4462aa3563deeef69f75a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1254287fde984bce95b195e8f52763e4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:01.463747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.466809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.467360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.468467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:01.470599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:01.473903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:01.544375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 941/1845] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:01.592184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 905/1846] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:25:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:01.675512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:01.677937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:01.723022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190b3fb-398e-4202-83ca-ada6a5df8deb tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:01.742136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:01.781200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:01.788937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.789304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.789694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.796838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c611037-0696-4bb5-941a-86b803738e64 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:01.834132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bec7feb817d4462aa3563deeef69f75a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1254287fde984bce95b195e8f52763e4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:01.834826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:01.835642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:01.837821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] PATH_INFO: `/v3/projects/b2784db83ca74d16bf2606b3be5a31fc` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:01.845196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2784db83ca74d16bf2606b3be5a31fc)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:01.845550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:01.854517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:01.856941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:01.891856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 942/1847] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:01.975809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:01.999438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2784db83ca74d16bf2606b3be5a31fc', 'request_id': 'req-00b44fb9-0a01-41df-bea7-9b56acc4d982'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:02.026129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2784db83ca74d16bf2606b3be5a31fc', 'request_id': 'req-00b44fb9-0a01-41df-bea7-9b56acc4d982'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:02.044922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2784db83ca74d16bf2606b3be5a31fc', 'request_id': 'req-00b44fb9-0a01-41df-bea7-9b56acc4d982'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:02.086975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] The token cache is being invalidate because project b2784db83ca74d16bf2606b3be5a31fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:02.087665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:02.092227 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-00b44fb9-0a01-41df-bea7-9b56acc4d982 tempest-VolumeQuotaClassesTest-862903493 tempest-VolumeQuotaClassesTest-862903493-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:02.107138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 906/1848] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:01 2022] DELETE /identity/v3/projects/b2784db83ca74d16bf2606b3be5a31fc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:02.723248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:02.725679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:02.985095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e9dc9-155e-4e90-818a-61995ed2fb8a service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:03.118281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:03.120748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:03.121258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:03.121975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] PATH_INFO: `/v3/users/788710a23812437592b30b0cac5c4642` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:03.124593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=788710a23812437592b30b0cac5c4642)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:03.127941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:03.247376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788710a23812437592b30b0cac5c4642'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:03.248242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788710a23812437592b30b0cac5c4642'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:03.264215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788710a23812437592b30b0cac5c4642'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:03.292754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788710a23812437592b30b0cac5c4642'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:03.295025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:03.315928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788710a23812437592b30b0cac5c4642'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:03.331625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:03.332214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:03.332214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:03.332658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 943/1849] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:02 2022] DELETE /identity/v3/users/788710a23812437592b30b0cac5c4642 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:03.389198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:03.390471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:03.583000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 907/1850] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:03.725237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:03.727639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:03.881677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:03.883590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:03.901958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e0646-f00b-4b39-ba72-0175beaddd9d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:03.909787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:03.910869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:03.911442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:03.912024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] PATH_INFO: `/v3/projects/e599465cb53b4a3aa55bed19fda02230` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:03.912714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c4e87-8f5f-4b2d-be29-77336122c0ca admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:03.914547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e599465cb53b4a3aa55bed19fda02230)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:03.919537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:03.942843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:03.943488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:03.944348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:03.944348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:03.971105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:03.975127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d068ea-c419-4a86-a07e-3eec3dab621a service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.005742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 944/1851] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:04.016855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e599465cb53b4a3aa55bed19fda02230', 'request_id': 'req-98981a3f-f0d3-4bca-84b1-6286b74e7c75'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.023654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e599465cb53b4a3aa55bed19fda02230', 'request_id': 'req-98981a3f-f0d3-4bca-84b1-6286b74e7c75'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.031454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e599465cb53b4a3aa55bed19fda02230', 'request_id': 'req-98981a3f-f0d3-4bca-84b1-6286b74e7c75'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.050147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] The token cache is being invalidate because project e599465cb53b4a3aa55bed19fda02230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:04.050612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.051414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98981a3f-f0d3-4bca-84b1-6286b74e7c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.055578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 908/1852] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:03 2022] DELETE /identity/v3/projects/e599465cb53b4a3aa55bed19fda02230 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:04.059332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.060227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.060661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.086088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:04.088556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.174088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 945/1853] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:04.188815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.189354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.189777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.224913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:04.226183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.234491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 909/1854] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:04.238835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.249538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd01eb0-0367-4eb4-a09d-24589b5e329a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.254806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.255502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.255931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.256229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.256897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:04.257228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.258853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.272256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 946/1855] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:04.276850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.287452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408e7d2-17e2-476e-962d-eec5c429d2a2 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.292325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.292961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.293241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.293510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.294174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.296129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.327938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 910/1856] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:04.329375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.340169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62add727-4a63-4770-a51c-68031ba5bdee admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.417729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.418386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.418772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.419053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.419740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.421677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.444971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 947/1857] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:04.449022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.460701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457f864-6325-4938-8eb8-2cf3c8016f41 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.467306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.468605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.469106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.469390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.470047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.471997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.488493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 911/1858] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:04.489952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.514825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5acfd-03ef-4a6d-9ff0-8b1cf7692a26 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.527228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.528898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.529298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.529652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.530913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.532945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.535358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.537646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.540393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:04.548950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:04.566468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399751e-8596-44f4-a1f3-5dfbe01e394d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.572967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 948/1859] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:04.584404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.586313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.586997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.587783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] PATH_INFO: `/v3/projects/4623174162374387be549d7c0b36fdfe` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.587886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.590277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4623174162374387be549d7c0b36fdfe)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.593620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.607474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5b5f3-2bb3-455a-b84f-9c11a2b03322 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.612946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.613923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.614162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.614528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] PATH_INFO: `/v3/projects/5b44aadefe0c4c268db421d198af3bae/users/3f5f58d740654c7a9ea095c0dded446c/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.631718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b44aadefe0c4c268db421d198af3bae, user_id=3f5f58d740654c7a9ea095c0dded446c, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.634941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.650436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 949/1860] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:04 2022] PUT /identity/v3/projects/5b44aadefe0c4c268db421d198af3bae/users/3f5f58d740654c7a9ea095c0dded446c/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:04.654474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.654474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.668459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4623174162374387be549d7c0b36fdfe', 'request_id': 'req-cc03c9d8-b99c-4d6a-b295-66c02400df8c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.675728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4623174162374387be549d7c0b36fdfe', 'request_id': 'req-cc03c9d8-b99c-4d6a-b295-66c02400df8c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.681811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4623174162374387be549d7c0b36fdfe', 'request_id': 'req-cc03c9d8-b99c-4d6a-b295-66c02400df8c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.696957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] The token cache is being invalidate because project 4623174162374387be549d7c0b36fdfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:04.697555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.698259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cc03c9d8-b99c-4d6a-b295-66c02400df8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.699911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 912/1861] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:04 2022] DELETE /identity/v3/projects/4623174162374387be549d7c0b36fdfe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:04.701657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.701943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.702240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.734275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32955947-4924-4465-a1b2-1b89a7832609 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.739478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] MFA Rules not processed for user `3f5f58d740654c7a9ea095c0dded446c`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:04.740966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.799801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.800350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.800635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.800911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] PATH_INFO: `/v3/users/677450a65fef4513849d62c956dff7fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.802045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=677450a65fef4513849d62c956dff7fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.804218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.813945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 913/1862] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:04.823024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.823024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.837553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ac96a-538a-49ba-94d6-874087f5911c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:04.843585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:04.844241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:04.844513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:04.848689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] PATH_INFO: `/v3/users/bec7feb817d4462aa3563deeef69f75a` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:04.850559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec7feb817d4462aa3563deeef69f75a)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:04.852617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:04.887740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677450a65fef4513849d62c956dff7fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.889930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677450a65fef4513849d62c956dff7fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.900559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677450a65fef4513849d62c956dff7fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.918449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec7feb817d4462aa3563deeef69f75a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.920224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec7feb817d4462aa3563deeef69f75a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.920671 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677450a65fef4513849d62c956dff7fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.922636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec7feb817d4462aa3563deeef69f75a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.930401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677450a65fef4513849d62c956dff7fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.934937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:04.944942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec7feb817d4462aa3563deeef69f75a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:04.953052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 950/1863] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:04 2022] DELETE /identity/v3/users/677450a65fef4513849d62c956dff7fc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:04.953052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:04.956890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:04.967083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:04.971047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ede8189-dd7b-4f72-b264-751d811e420a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec7feb817d4462aa3563deeef69f75a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.004718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 914/1864] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:04 2022] DELETE /identity/v3/users/bec7feb817d4462aa3563deeef69f75a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:05.006011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.006415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.006690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.034919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:05.037010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.143455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 915/1865] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:05.153620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e418e-da01-488b-b77b-ca706dcb8e8e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.162248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.163925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.165524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.165966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.170474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.172387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.175189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.182716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.245640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 951/1866] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:04 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:05.251159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.312304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794bf1-e437-4fbd-99ac-ea1a81e33cfe None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.398143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dae4a-b925-4b7a-b0e3-ef625b57c11d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.409333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.409960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.410262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.410539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.411328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.413366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.439300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.445146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.448521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 952/1867] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:05 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:05.448521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.449662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.450564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.450931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.470936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea51d-c997-484a-b917-ef4022df9966 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.479344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.482745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.484835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.484835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] PATH_INFO: `/v3/users/d06f2f818f2f4cd5808eda4503dfdc0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.487810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06f2f818f2f4cd5808eda4503dfdc0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.494926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.499444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.506656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.550670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 916/1868] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:05.552439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.574491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e9e50-ccf7-44df-876d-f2632945a15d service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.582648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.583494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.584925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.585414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.586246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.588554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.608949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 917/1869] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:05.613334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06f2f818f2f4cd5808eda4503dfdc0b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.614363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06f2f818f2f4cd5808eda4503dfdc0b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.615122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.644542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fec86-d0fa-46c0-b357-87a90bd20313 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.659851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.660538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.660825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.661097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] PATH_INFO: `/v3/projects/2fba816bde524e13ab059b6caad0afaa/users/57031e30b6ec416faf43fe4402b510e6/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.667967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06f2f818f2f4cd5808eda4503dfdc0b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.682485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fba816bde524e13ab059b6caad0afaa, user_id=57031e30b6ec416faf43fe4402b510e6, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.686974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644718b-14ee-40ad-8071-6d52d772d661 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.687186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:05.688752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06f2f818f2f4cd5808eda4503dfdc0b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.698724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06f2f818f2f4cd5808eda4503dfdc0b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:05.713943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 953/1871] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:05 2022] DELETE /identity/v3/users/d06f2f818f2f4cd5808eda4503dfdc0b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:05.714833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 918/1871] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:05 2022] PUT /identity/v3/projects/2fba816bde524e13ab059b6caad0afaa/users/57031e30b6ec416faf43fe4402b510e6/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:05.717875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.718159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.718608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.719053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.725610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.745140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:05.747579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.753215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:05.853647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 919/1872] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:05.863058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093c210-f6ef-4ca4-88ec-42842a1f399b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.865213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.867746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:05.869695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.870315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.870608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.871248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.872757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.875115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.887126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 954/1873] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:05.891583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:05.907436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2c44-13a0-4c8f-95d2-735dd1cce37e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.914543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:05.918250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.919279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.919673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] PATH_INFO: `/v3/projects/2fba816bde524e13ab059b6caad0afaa/users/57031e30b6ec416faf43fe4402b510e6/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.923182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fba816bde524e13ab059b6caad0afaa, user_id=57031e30b6ec416faf43fe4402b510e6, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:05.927066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406d184-32fd-4b8b-b3fa-0ee29ed768ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:05.944597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 955/1874] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:05 2022] PUT /identity/v3/projects/2fba816bde524e13ab059b6caad0afaa/users/57031e30b6ec416faf43fe4402b510e6/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:05.957682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:05.957966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:05.958266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:05.966591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29918-2a0c-440b-b7b0-3d9ce24cabaf None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:05.995659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] MFA Rules not processed for user `57031e30b6ec416faf43fe4402b510e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:05.997936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.039942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.040559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.040842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.041119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.080925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 956/1875] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:06.081791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.083138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.118277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.120060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.133257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 920/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:06.134203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.136205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.158505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:06.165192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36890c4-7959-4252-9cad-a598ed373600 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.165546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:06.180898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.181557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.181837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.182135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] PATH_INFO: `/v3/projects/1254287fde984bce95b195e8f52763e4` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.184881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1254287fde984bce95b195e8f52763e4)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.189323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.234822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f3403-9e32-419c-9a24-02b9649a576d service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.240856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.241494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.241791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.242474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.257599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.260476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d36a57-c040-4282-9299-ca56e8bdcd70 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.275696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 921/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:06.290519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1254287fde984bce95b195e8f52763e4', 'request_id': 'req-379df75e-17f6-4d33-8c51-84a8b429baf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.310677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1254287fde984bce95b195e8f52763e4', 'request_id': 'req-379df75e-17f6-4d33-8c51-84a8b429baf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.349771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1254287fde984bce95b195e8f52763e4', 'request_id': 'req-379df75e-17f6-4d33-8c51-84a8b429baf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.367884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] The token cache is being invalidate because project 1254287fde984bce95b195e8f52763e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:06.368555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.377487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-379df75e-17f6-4d33-8c51-84a8b429baf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.379193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 957/1878] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:06 2022] DELETE /identity/v3/projects/1254287fde984bce95b195e8f52763e4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:06.384590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb996-9a46-40f7-990c-791af373039c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.384802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb996-9a46-40f7-990c-791af373039c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.385079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb996-9a46-40f7-990c-791af373039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.419973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e91fb996-9a46-40f7-990c-791af373039c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:06.421336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e91fb996-9a46-40f7-990c-791af373039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.532480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 922/1879] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:06.540676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.540968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.541247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.567006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:06.568879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.589106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fb996-9a46-40f7-990c-791af373039c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.591434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e91fb996-9a46-40f7-990c-791af373039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.598899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 958/1880] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:06.603079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.608117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fb996-9a46-40f7-990c-791af373039c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.612967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.613731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.614086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.615543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] PATH_INFO: `/v3/projects/e79ac16b681e41f0b39df604bf61026d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.617140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79ac16b681e41f0b39df604bf61026d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.618955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653a6c4-5b7e-4a18-bf2e-e49f9969240a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.620480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.625570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.626295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.626581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.626904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.627571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:06.627881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.629779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.657198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 959/1881] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:06.657198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.664330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.682484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dacb9d-12bc-4f03-958d-15f3c909fab9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.694978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.695659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.695911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.696180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] PATH_INFO: `/v3/projects/acc64eddbd634200a389cce92f075a10` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.699991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc64eddbd634200a389cce92f075a10)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.702626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:06.727419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79ac16b681e41f0b39df604bf61026d', 'request_id': 'req-a5ba343c-47b4-460b-90c0-8eaffb85954a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.736486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79ac16b681e41f0b39df604bf61026d', 'request_id': 'req-a5ba343c-47b4-460b-90c0-8eaffb85954a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.750975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79ac16b681e41f0b39df604bf61026d', 'request_id': 'req-a5ba343c-47b4-460b-90c0-8eaffb85954a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.768865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] The token cache is being invalidate because project e79ac16b681e41f0b39df604bf61026d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:06.769281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.770033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.776223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 923/1882] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:06 2022] DELETE /identity/v3/projects/e79ac16b681e41f0b39df604bf61026d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:06.777798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.780467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.794164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc64eddbd634200a389cce92f075a10', 'request_id': 'req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.812282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc64eddbd634200a389cce92f075a10', 'request_id': 'req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.826952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc64eddbd634200a389cce92f075a10', 'request_id': 'req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.849225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] The token cache is being invalidate because project acc64eddbd634200a389cce92f075a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:06.849525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.850520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:06.853004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 960/1883] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:06 2022] DELETE /identity/v3/projects/acc64eddbd634200a389cce92f075a10 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:06.853701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:06.857974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:06.894187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:06.927842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba343c-47b4-460b-90c0-8eaffb85954a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.944555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:06.967097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903caf1b-30b7-4d09-ae0c-1fd9a68e3ba7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:06.982800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:06.983767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:06.984254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:06.984742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] PATH_INFO: `/v3/users/a8e4ae1affea4ed08e2b908a554911f8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:06.986300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e4ae1affea4ed08e2b908a554911f8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:06.993135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.013111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.013821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.014107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.014461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.015757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.018535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.060364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 924/1884] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:06 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:07.061008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.066482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.067439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e4ae1affea4ed08e2b908a554911f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.069212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e4ae1affea4ed08e2b908a554911f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.079868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e4ae1affea4ed08e2b908a554911f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.104262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e4ae1affea4ed08e2b908a554911f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.114405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e4ae1affea4ed08e2b908a554911f8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.127390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 961/1885] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:06 2022] DELETE /identity/v3/users/a8e4ae1affea4ed08e2b908a554911f8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:07.129088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.131724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.182906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef2f27-8317-40aa-ac25-2da690d51a5c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.246692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81548e6-0b65-4682-b3bf-df694919bdb0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.257116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.259341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.259814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.260393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] PATH_INFO: `/v3/users/3f5f58d740654c7a9ea095c0dded446c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.263891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5f58d740654c7a9ea095c0dded446c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.266423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.317913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.319109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.319399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.319697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] PATH_INFO: `/v3/users/fba761b706444199aca2b2be0b524177` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.323557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba761b706444199aca2b2be0b524177)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.323557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.342394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5f58d740654c7a9ea095c0dded446c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.343199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5f58d740654c7a9ea095c0dded446c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.353263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5f58d740654c7a9ea095c0dded446c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.355437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:07.367596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:07.371210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5f58d740654c7a9ea095c0dded446c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.383152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5f58d740654c7a9ea095c0dded446c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.384221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba761b706444199aca2b2be0b524177'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.385066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba761b706444199aca2b2be0b524177'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.386030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba761b706444199aca2b2be0b524177'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.390954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 962/1886] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:07 2022] DELETE /identity/v3/users/3f5f58d740654c7a9ea095c0dded446c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:07.392242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.394463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.394892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba761b706444199aca2b2be0b524177'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.408448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8e495b20-a0d1-4fb1-8182-c238ecf0fc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba761b706444199aca2b2be0b524177'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.425425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 925/1887] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:07 2022] DELETE /identity/v3/users/fba761b706444199aca2b2be0b524177 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:07.427311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.427669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.428019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.451540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:07.453192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.488208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d3a28-1fc6-4db8-9a62-95d71aadb91b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.544848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 926/1888] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:07.546030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.547814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.564558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367e940-cdeb-4bda-a81f-ffcba6d13edd None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.570151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.571098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.571449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.571806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] PATH_INFO: `/v3/projects/0b8a7b63a5f8494a819857ca00db8a8d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.573399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8a7b63a5f8494a819857ca00db8a8d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.576439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.587729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.588685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.590590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.591192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.592169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.595864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.654901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 963/1889] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:07 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:07.654901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.660721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.666916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8a7b63a5f8494a819857ca00db8a8d', 'request_id': 'req-50d3603f-959a-41e6-b653-e64bd0ec03fc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.673881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8a7b63a5f8494a819857ca00db8a8d', 'request_id': 'req-50d3603f-959a-41e6-b653-e64bd0ec03fc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.681046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8a7b63a5f8494a819857ca00db8a8d', 'request_id': 'req-50d3603f-959a-41e6-b653-e64bd0ec03fc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.698107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] The token cache is being invalidate because project 0b8a7b63a5f8494a819857ca00db8a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:07.698449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.699412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.706019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 927/1890] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:07 2022] DELETE /identity/v3/projects/0b8a7b63a5f8494a819857ca00db8a8d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:07.707720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.708806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.752761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50480c-e27d-406a-817a-708e1c2c5a08 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.753165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:07.802936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3603f-959a-41e6-b653-e64bd0ec03fc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.807652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.808274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.808703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.808858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:07.808976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.810378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.812332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.830757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 928/1891] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:07.830757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.831250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.834205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.835005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.835430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.835879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.838524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.848491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5533a0-5003-4f32-a061-f3f9e2f0e7e7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.858998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.858998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.868705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.869580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.869855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.870249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] PATH_INFO: `/v3/users/845a147973ee482f84d5958ed23b7809` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.871368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845a147973ee482f84d5958ed23b7809)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.873363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.875329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 964/1892] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:07.876366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.888192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e133f6-0617-49ba-b42a-49b2a1d44cc7 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.894602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.895215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.895496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.895771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.897227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.899060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.913514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 965/1893] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:07.914732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.917951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:07.936238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b61f17-d607-45c5-b60c-df3d37f6fba8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:07.944646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:07.945366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:07.945604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845a147973ee482f84d5958ed23b7809'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.945754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:07.946151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] PATH_INFO: `/v3/projects/939b1fd9d56c44a29705d1603ead4575` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:07.946409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845a147973ee482f84d5958ed23b7809'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.947434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845a147973ee482f84d5958ed23b7809'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.947545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939b1fd9d56c44a29705d1603ead4575)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:07.951141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:07.957628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845a147973ee482f84d5958ed23b7809'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.975781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845a147973ee482f84d5958ed23b7809'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:07.991731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 929/1894] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:07 2022] DELETE /identity/v3/users/845a147973ee482f84d5958ed23b7809 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:07.992715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:07.994138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.014503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939b1fd9d56c44a29705d1603ead4575', 'request_id': 'req-7f52950d-ccd6-4428-9613-66e962fa0170'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.027190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939b1fd9d56c44a29705d1603ead4575', 'request_id': 'req-7f52950d-ccd6-4428-9613-66e962fa0170'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.038956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939b1fd9d56c44a29705d1603ead4575', 'request_id': 'req-7f52950d-ccd6-4428-9613-66e962fa0170'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.062528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] The token cache is being invalidate because project 939b1fd9d56c44a29705d1603ead4575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:08.063394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.064278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f52950d-ccd6-4428-9613-66e962fa0170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.066544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 966/1895] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:07 2022] DELETE /identity/v3/projects/939b1fd9d56c44a29705d1603ead4575 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:08.071406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46207-bfd8-48a4-855c-1db8b6538239 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.071815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46207-bfd8-48a4-855c-1db8b6538239 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.072218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46207-bfd8-48a4-855c-1db8b6538239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.097717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f4c46207-bfd8-48a4-855c-1db8b6538239 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:08.099348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f4c46207-bfd8-48a4-855c-1db8b6538239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.100854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d968a-265d-4acf-8bfb-540f37f407a7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.173261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:08.192069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 967/1896] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:08.200071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.200634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.200983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.205542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.206405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.206758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.207114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] PATH_INFO: `/v3/projects/a37f4f6a2f0b4997a64e719944e56adb/users/6f81093c7df44a5baa561175470ef8d5/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.226151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37f4f6a2f0b4997a64e719944e56adb, user_id=6f81093c7df44a5baa561175470ef8d5, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.229244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933bf89-e600-450a-aa9a-4dccb31174f4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.238532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:08.240202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.252301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 968/1897] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:08.253615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.259110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 930/1898] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:07 2022] PUT /identity/v3/projects/a37f4f6a2f0b4997a64e719944e56adb/users/6f81093c7df44a5baa561175470ef8d5/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:08.271478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.271911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.272193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.273251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612e2c-1f9a-49cc-b7ec-ba1ad7da89ce None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.313009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] MFA Rules not processed for user `6f81093c7df44a5baa561175470ef8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:08.314703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.360874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:08.387867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.390292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.390731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.391171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.392250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:08.392847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.394438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 931/1899] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:08.394839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.418409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 969/1900] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:08.420079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.428665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.430664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.433464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030401d-028d-463f-a5f0-9b4a517bee43 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.438806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.439011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.439379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.439863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.440463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.442498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.477594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 932/1901] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:08 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:08.478655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.568385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa011-9a3a-4a3e-abca-92e5955e5bb8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.578124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435804-dbd8-4d3d-a7df-741d39e747f2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.583276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.583668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.583966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.584301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.584941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.587896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.636426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 933/1902] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:08 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:08.638541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.641230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.660984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f8448-5662-40bf-9f04-f3369ebec767 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.666237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.667187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.667502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.667874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] PATH_INFO: `/v3/projects/5b44aadefe0c4c268db421d198af3bae` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.670537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b44aadefe0c4c268db421d198af3bae)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.672862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.677742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.679360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.679814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.680430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.695566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:08.734122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b44aadefe0c4c268db421d198af3bae', 'request_id': 'req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.742494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b44aadefe0c4c268db421d198af3bae', 'request_id': 'req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.749118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b44aadefe0c4c268db421d198af3bae', 'request_id': 'req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.754375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.755912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.766492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] The token cache is being invalidate because project 5b44aadefe0c4c268db421d198af3bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:08.767110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.768123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:08.768853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 970/1903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:08.769718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.770374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 934/1904] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:08 2022] DELETE /identity/v3/projects/5b44aadefe0c4c268db421d198af3bae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:08.771472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.773097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.774284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.814344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe0ab9-ff34-4849-a6a2-1a9b1f437c14 service glance] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.881398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:08.907273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4424-d52d-4f0a-b795-bc6dedcbd6e4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.914176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.917490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.917746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.918031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.918869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.921010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.929668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.930691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.930976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.931313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] PATH_INFO: `/v3/projects/87a4c4acdd06478f87b8526e8d377f5e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.932752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a4c4acdd06478f87b8526e8d377f5e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.934978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:08.942727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 935/1905] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:08.942727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:08.943425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:08.973344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7365d-df07-429f-89b2-db3cf81c308e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:08.980066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:08.980737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:08.981089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:08.981644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] PATH_INFO: `/v3/users/57031e30b6ec416faf43fe4402b510e6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:08.983014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57031e30b6ec416faf43fe4402b510e6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:08.986548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.007074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a4c4acdd06478f87b8526e8d377f5e', 'request_id': 'req-15fe1951-8b75-4ee9-8105-72a81deb5697'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.025034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a4c4acdd06478f87b8526e8d377f5e', 'request_id': 'req-15fe1951-8b75-4ee9-8105-72a81deb5697'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.036967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a4c4acdd06478f87b8526e8d377f5e', 'request_id': 'req-15fe1951-8b75-4ee9-8105-72a81deb5697'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.046659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57031e30b6ec416faf43fe4402b510e6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.049763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57031e30b6ec416faf43fe4402b510e6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.050447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57031e30b6ec416faf43fe4402b510e6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.052300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] The token cache is being invalidate because project 87a4c4acdd06478f87b8526e8d377f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:09.052601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.053420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.060484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 971/1906] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:08 2022] DELETE /identity/v3/projects/87a4c4acdd06478f87b8526e8d377f5e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:09.060484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.060484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.064376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57031e30b6ec416faf43fe4402b510e6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.078993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0914c68d-510c-4943-9706-7426280e2c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57031e30b6ec416faf43fe4402b510e6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.093042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 936/1907] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:08 2022] DELETE /identity/v3/users/57031e30b6ec416faf43fe4402b510e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:09.094292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6786f6-c48c-4e6d-a899-3c0f9c3748dc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.094717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6786f6-c48c-4e6d-a899-3c0f9c3748dc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.095112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6786f6-c48c-4e6d-a899-3c0f9c3748dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.129421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9a6786f6-c48c-4e6d-a899-3c0f9c3748dc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:09.131040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9a6786f6-c48c-4e6d-a899-3c0f9c3748dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.149209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:09.174641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe1951-8b75-4ee9-8105-72a81deb5697 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.255308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 937/1908] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:09.285473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.285473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.285473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.363677 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.364706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.364996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.365311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.366138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.367879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.381866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 972/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:09.382061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:09.383303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.387206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.402889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0b60-d621-4e2b-8c13-25a489753f5f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.406562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 938/1910] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:09.411010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.415153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.416653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.416947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.417383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] PATH_INFO: `/v3/projects/78ba42e4e40e435398f3907c189ad9c6/users/3fc716a23dfc448fa4efbd87a2a4a15c/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.421250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:09.425647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab56d0-eec9-4d8d-8513-77aa82b197d2 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.431214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.431907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.432264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.432605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.433397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:09.433774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.435523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.452904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 939/1911] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:09.455220 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ba42e4e40e435398f3907c189ad9c6, user_id=3fc716a23dfc448fa4efbd87a2a4a15c, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.461258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.463863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dee03e-0199-4f73-8dd0-c1179023dc09 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.483222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3028af7-6b1f-4c5d-b018-9637ad240595 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.498249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 973/1912] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:09 2022] PUT /identity/v3/projects/78ba42e4e40e435398f3907c189ad9c6/users/3fc716a23dfc448fa4efbd87a2a4a15c/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:09.500152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.500498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.500905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.562270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] MFA Rules not processed for user `3fc716a23dfc448fa4efbd87a2a4a15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:09.562270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.601382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.603483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.604151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.604437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.605662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.608586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.660574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 940/1913] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:09.667055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.669301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.685510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 974/1914] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:09.686659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.702245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d117b-fedd-48fe-b43a-0c6165b03234 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.751708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffba3-2c92-4f89-a056-bcaf0749abe4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.758861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.759583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.759859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.760523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] PATH_INFO: `/v3/projects/2fba816bde524e13ab059b6caad0afaa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.761508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fba816bde524e13ab059b6caad0afaa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.764305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.770780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.771498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.772204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.772204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.772846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.774877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.788603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:09.800025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 975/1915] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:09.800872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.811198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4db13e-6a1c-4502-9946-be8de30804e9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.824949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fba816bde524e13ab059b6caad0afaa', 'request_id': 'req-fc37aca8-26e4-40a6-a449-46d83ab8579a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.838864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fba816bde524e13ab059b6caad0afaa', 'request_id': 'req-fc37aca8-26e4-40a6-a449-46d83ab8579a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.846199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fba816bde524e13ab059b6caad0afaa', 'request_id': 'req-fc37aca8-26e4-40a6-a449-46d83ab8579a'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.860672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] The token cache is being invalidate because project 2fba816bde524e13ab059b6caad0afaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:09.860993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.861645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:09.863233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 941/1916] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:09 2022] DELETE /identity/v3/projects/2fba816bde524e13ab059b6caad0afaa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:09.866699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:09.866699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:09.881673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:09.882455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.882830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.883244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.883950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:09.885937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c7f5e-8ee5-4c05-b7f1-a0b520f715a4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:09.892626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:09.919082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 976/1917] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:09.920785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:09.921077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:09.922300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:09.944554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37aca8-26e4-40a6-a449-46d83ab8579a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:09.955709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:09.956992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.017683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.018441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.018724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.018999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.019721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.021360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.031606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 977/1918] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:10.036172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 942/1919] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:10.036312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.037544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.038665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.051208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5216e9-4286-4e8a-bdad-bfd87189a375 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.054207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7252c-e77e-4e63-bcb2-23089466b8b6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.055924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.056527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.056808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.057109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.057750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.059901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068014-7ae1-4a81-98cf-e0e969db96c4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.061395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.062374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.062793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.063256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.064042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.066881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.073742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 943/1920] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:10.073742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.073742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.073742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.093925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 978/1921] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/users => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:10.097936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.099020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:10.100250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.118379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 944/1922] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:10.118379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.118545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb47e-4a9f-4a4d-a23b-13117d1f5544 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.124688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.125584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.125850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.126132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] PATH_INFO: `/v3/projects/23f83e64eab246299d50db7b26759e28/users/431d728ddce047a6b7db68691b8cc864/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.127562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd8295-9f12-449f-a15d-7d68554c04c9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.134573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.135320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.135703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.136078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.137412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.139781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.145944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f83e64eab246299d50db7b26759e28, user_id=431d728ddce047a6b7db68691b8cc864, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.148909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.151221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 945/1923] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:10.151987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.163271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08935-f419-4546-aaa8-9474c005eb09 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.172114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 979/1924] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:10 2022] PUT /identity/v3/projects/23f83e64eab246299d50db7b26759e28/users/431d728ddce047a6b7db68691b8cc864/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:10.173062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.216507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:10.282953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.284257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.285416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.286161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.287145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:10.287488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.290886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3c098-9730-46b7-902f-a925938c77a8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.298027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca29d-4345-424f-a36b-7dbcf1335928 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.305266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.306138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.306556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.306933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] PATH_INFO: `/v3/projects/918df7813e60451d8d6a3869e227e778/users/c75f5514c3b943139e2b65b470a629b8/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.312500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 946/1925] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:10.312500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.312500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.312500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.342270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918df7813e60451d8d6a3869e227e778, user_id=c75f5514c3b943139e2b65b470a629b8, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.345089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.358830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 980/1926] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:10 2022] PUT /identity/v3/projects/918df7813e60451d8d6a3869e227e778/users/c75f5514c3b943139e2b65b470a629b8/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:10.359028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] MFA Rules not processed for user `431d728ddce047a6b7db68691b8cc864`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:10.359713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.360344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.390753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:10.428283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcf1f-637b-4411-a775-3ecdb5ccfc26 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.432839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.433432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.433711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.433982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.434190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 947/1927] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:10.435536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.435636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.437736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.446771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9c65-528e-489b-a6a7-aa5341f333ff None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.451434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.452037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.452316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.452586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.453226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.454846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.465319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 948/1928] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:10.466799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 981/1929] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:10.467541 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.470055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.471166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.535452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14325c65-247a-4a7a-b40c-d359d4ade63d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.544204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4c548-06d3-419a-bf59-e6d3daaca4f8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.549338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.549991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.550300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.550663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] PATH_INFO: `/v3/projects/918df7813e60451d8d6a3869e227e778/users/c75f5514c3b943139e2b65b470a629b8/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.552573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918df7813e60451d8d6a3869e227e778, user_id=c75f5514c3b943139e2b65b470a629b8, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.555665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.566056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 982/1930] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:10 2022] PUT /identity/v3/projects/918df7813e60451d8d6a3869e227e778/users/c75f5514c3b943139e2b65b470a629b8/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:10.566864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.593429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.594029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.594336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.594605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.607011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:10.635425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ed8dd-a902-42b3-a203-f96879d68965 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.642131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.643122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.643400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.644155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.644641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.647136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb810cec-83ff-49c0-a6a4-f1db9e0474ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.687953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.688107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 983/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:10.689577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.689938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.690058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.690374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.704112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 949/1932] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:10.710552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.730986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6445-0803-40ed-a3d6-cc729d517a11 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.744011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.744638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.744919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.745194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.745839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.748083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.755036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] MFA Rules not processed for user `c75f5514c3b943139e2b65b470a629b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:10.757003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.791614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 950/1933] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:10.792552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.804076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd10bd-bc55-46ba-91a3-e57bffb8c8ce admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.809967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.810707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.811611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.811611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.812032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.820319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.824689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:10.855569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 951/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:10.881274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.900756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802195fb-2633-4dd4-9d0c-07a965e269b9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:10.914521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:10.915692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.916406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.917272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] PATH_INFO: `/v3/projects/36dce760b40e4b4c9ebefb535bda6173/users/254d380de4ae4533afeaf10701f70ab6/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:10.953549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36dce760b40e4b4c9ebefb535bda6173, user_id=254d380de4ae4533afeaf10701f70ab6, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:10.957850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 984/1935] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:10.958897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb465d-6670-41a4-9b20-7d6ebc362bc8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:10.980576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:10.983162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:10.992446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 952/1936] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:10 2022] PUT /identity/v3/projects/36dce760b40e4b4c9ebefb535bda6173/users/254d380de4ae4533afeaf10701f70ab6/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:10.994271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:10.994271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:10.994483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:11.031229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:11.032464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:11.097701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6972f93-d9c7-444b-89d6-72106dc23bdd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:11.197024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 953/1937] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:11.216417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:11.218480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:11.231015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:11.232195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:11.232479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:11.232844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:11.331594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d62a6-776b-4ada-9409-9c5b30015dcb None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:11.345158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:11.346938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:11.347221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:11.348510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:11.371331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:11.371331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:11.399808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 954/1938] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:11.417129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:11.419209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322e959-b3b4-4a42-8234-e469dd195e94 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:11.445068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 985/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:11.525054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:11.532533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:11.539747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3711f7-e9d2-4832-b647-ce5b14a60bff service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:11.549486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:11.550075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:11.550390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:11.550663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:11.555219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:11.705408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:11.708921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:11.733100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 955/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:12.550429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:12.550966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:12.551066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:12.605495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] MFA Rules not processed for user `254d380de4ae4533afeaf10701f70ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:12.606868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:12.627637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:12.677342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 986/1941] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:12.681770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:12.693029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b067bd-cc50-4830-a81a-1d424e84cd79 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:12.709736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:12.710403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:12.710686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:12.710960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:12.711612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:12.713533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:12.756094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 956/1942] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:12 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:12.760127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:12.775320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32419a7-0ea0-4028-a29c-0612128b8c75 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:12.903416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:12.903837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:12.904498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:12.904957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:12.905627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:12.909468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:12.947173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 987/1943] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:12 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:12.952075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:12.974060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b76e-6ae6-4895-aad5-619a0c741c86 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:12.982558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:12.982790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:12.982957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:12.983231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:12.983886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:12.985580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:13.003577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 957/1944] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:13.004448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:13.022078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f395-ae5c-44aa-94dc-1e5cc6497d20 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:13.030510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:13.031362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:13.031768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:13.032151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] PATH_INFO: `/v3/projects/21d1183a69654d839e45e122530994e6/users/39f1951e8052489680eab1767f310ad3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:13.054005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d1183a69654d839e45e122530994e6, user_id=39f1951e8052489680eab1767f310ad3, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:13.058181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:13.078204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 988/1945] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:13 2022] PUT /identity/v3/projects/21d1183a69654d839e45e122530994e6/users/39f1951e8052489680eab1767f310ad3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:13.082480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:13.096040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6403-4589-4d8a-b693-a56a0ec68189 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:13.169987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:13.170865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:13.171037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:13.171397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:13.173963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:13.175805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36ea95-5313-4784-961f-65100375e948 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:13.186907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 958/1946] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:13.191612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:13.203348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1e126-a469-431b-90d7-5c5222a3b3d4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:13.210906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:13.211482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:13.211751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:13.212029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] PATH_INFO: `/v3/projects/21d1183a69654d839e45e122530994e6/users/39f1951e8052489680eab1767f310ad3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:13.214114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d1183a69654d839e45e122530994e6, user_id=39f1951e8052489680eab1767f310ad3, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:13.217953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a558cb8-7436-4917-8afd-cb05bee43ffd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:13.230473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 989/1947] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:13 2022] PUT /identity/v3/projects/21d1183a69654d839e45e122530994e6/users/39f1951e8052489680eab1767f310ad3/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:14.272438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:14.273024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:14.273279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:14.324484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] MFA Rules not processed for user `39f1951e8052489680eab1767f310ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:14.325907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:14.407528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:14.432019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 959/1948] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:14.443033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:14.443478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:14.443660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:14.487969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] MFA Rules not processed for user `254d380de4ae4533afeaf10701f70ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:14.489337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:14.578191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 990/1949] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:14.608186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:14.609924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:14.729249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e784-eecb-4973-8416-c2e9f2d031f9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:14.736197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:14.736897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:14.737498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:14.738021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:14.749714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:14.751071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc4a5d-4c52-4a6b-bd82-cccaa88c4b80 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:14.766399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 960/1950] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:14.920565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:14.925083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc7ac-5d00-489b-9ac2-79c222c78e72 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:14.925658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc7ac-5d00-489b-9ac2-79c222c78e72 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:14.926114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc7ac-5d00-489b-9ac2-79c222c78e72 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:14.927016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:14.930475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 961/1951] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:25:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:25:14.936999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:14.937284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:14.937563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:14.977416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:15.005383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:15.006805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.040979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 962/1952] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:15.070008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c03-ee09-4292-8077-986a9ff57570 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:15.078848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:15.080391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:15.080969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:15.081429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] PATH_INFO: `/v3/users/8475ef940d164a44a4eefcb8249737e5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:15.082894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8475ef940d164a44a4eefcb8249737e5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:15.085168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:15.161415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8475ef940d164a44a4eefcb8249737e5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.162192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8475ef940d164a44a4eefcb8249737e5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.181551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8475ef940d164a44a4eefcb8249737e5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.190564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:15.190696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.208315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf6fa6-7476-49d9-bc89-a3adc14d3b1b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:15.211746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8475ef940d164a44a4eefcb8249737e5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.219516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:15.221380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:15.221822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:15.222360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:15.224496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c9661e4-50c2-4594-8045-ddff73ba411c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8475ef940d164a44a4eefcb8249737e5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.237474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 991/1953] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:14 2022] DELETE /identity/v3/users/8475ef940d164a44a4eefcb8249737e5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:15.241032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.242914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:15.243209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:15.244061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:15.267493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:15.268943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.274801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:15.278705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:15.292358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 963/1954] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:15.386433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 992/1955] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:15.407925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:15.409627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.505062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6738ad-6081-44f9-b5ab-5ac9e8e64f5c service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:15.638195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:15.638864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:15.639148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:15.641394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:15.659506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:15.661664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d23cf4-2d2f-4cea-ab96-d22c7664d816 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:15.676489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 964/1956] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:15.731069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:15.733421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:15.757787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033640f-bac4-44bf-9534-bf68bbf6548e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:15.766399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:15.767594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:15.768028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:15.768423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] PATH_INFO: `/v3/users/3fc716a23dfc448fa4efbd87a2a4a15c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:15.769926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc716a23dfc448fa4efbd87a2a4a15c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:15.772241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:15.894248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:15.925600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc716a23dfc448fa4efbd87a2a4a15c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.927496 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc716a23dfc448fa4efbd87a2a4a15c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.960541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc716a23dfc448fa4efbd87a2a4a15c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.983104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc716a23dfc448fa4efbd87a2a4a15c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:15.992454 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc716a23dfc448fa4efbd87a2a4a15c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.000469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 993/1957] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:15 2022] DELETE /identity/v3/users/3fc716a23dfc448fa4efbd87a2a4a15c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:16.004754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:16.005031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:16.005334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:16.057021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:16.058484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:16.069552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:16.152395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 965/1958] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:16.177719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:16.180956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:16.288359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:16.290678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:16.307251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d774be-d2ca-46eb-8a08-c2f546c5c19c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:16.321009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:16.321767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:16.322208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:16.322774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] PATH_INFO: `/v3/projects/b7b970e6ecc7403b9a284aa204af426d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:16.326592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b970e6ecc7403b9a284aa204af426d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:16.329877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:16.362063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94533f14-4088-411f-bf76-8aa4d0fc37e6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:16.374469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:16.375187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:16.375545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:16.375821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:16.405535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:16.406527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:16.423301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 994/1959] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:16.432954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b970e6ecc7403b9a284aa204af426d', 'request_id': 'req-d8c0af45-9006-4323-be84-c0c413014c33'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.454321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b970e6ecc7403b9a284aa204af426d', 'request_id': 'req-d8c0af45-9006-4323-be84-c0c413014c33'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.467721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b970e6ecc7403b9a284aa204af426d', 'request_id': 'req-d8c0af45-9006-4323-be84-c0c413014c33'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.485133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] The token cache is being invalidate because project b7b970e6ecc7403b9a284aa204af426d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:16.485501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.486499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.488357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 966/1960] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:16 2022] DELETE /identity/v3/projects/b7b970e6ecc7403b9a284aa204af426d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:16.492312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:16.503218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f28fc-9122-4792-af67-2c1409dc8f84 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:16.574326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:16.574882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:16.575265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:16.575732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] PATH_INFO: `/v3/users/a964425f4d54488b875d171d337c9e13` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:16.577495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a964425f4d54488b875d171d337c9e13)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:16.579489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:16.639253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a964425f4d54488b875d171d337c9e13'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.639939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a964425f4d54488b875d171d337c9e13'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.644158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:16.648626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a964425f4d54488b875d171d337c9e13'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.664526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a964425f4d54488b875d171d337c9e13'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.671424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a964425f4d54488b875d171d337c9e13'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:16.677685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 995/1961] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:16 2022] DELETE /identity/v3/users/a964425f4d54488b875d171d337c9e13 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:16.803109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:16.804990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:16.854439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0af45-9006-4323-be84-c0c413014c33 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:16.975729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:16.976696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:16.977877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:16.980136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] PATH_INFO: `/v3/projects/78ba42e4e40e435398f3907c189ad9c6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:16.983708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ba42e4e40e435398f3907c189ad9c6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:16.986510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:17.003617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:17.006058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:17.050250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:17.061032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ba42e4e40e435398f3907c189ad9c6', 'request_id': 'req-8040a547-2ce6-44cb-af89-33476ca72235'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.066026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b0a13-0d15-45be-b693-b9dd70f5abcb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:17.069638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ba42e4e40e435398f3907c189ad9c6', 'request_id': 'req-8040a547-2ce6-44cb-af89-33476ca72235'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.077413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ba42e4e40e435398f3907c189ad9c6', 'request_id': 'req-8040a547-2ce6-44cb-af89-33476ca72235'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.096903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] The token cache is being invalidate because project 78ba42e4e40e435398f3907c189ad9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:17.097628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.098583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.100965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 967/1962] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:16 2022] DELETE /identity/v3/projects/78ba42e4e40e435398f3907c189ad9c6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:17.104745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:17.107602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:17.180327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:17.182048 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.182623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.186475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] PATH_INFO: `/v3/users/431d728ddce047a6b7db68691b8cc864` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.188128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431d728ddce047a6b7db68691b8cc864)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:17.190051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:17.213364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a547-2ce6-44cb-af89-33476ca72235 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:17.219437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:17.220144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.220415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.220900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] PATH_INFO: `/v3/users/c75f5514c3b943139e2b65b470a629b8` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.222285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75f5514c3b943139e2b65b470a629b8)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:17.224876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:17.282964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431d728ddce047a6b7db68691b8cc864'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.283764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431d728ddce047a6b7db68691b8cc864'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.296079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431d728ddce047a6b7db68691b8cc864'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.305276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75f5514c3b943139e2b65b470a629b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.306658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75f5514c3b943139e2b65b470a629b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.308053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75f5514c3b943139e2b65b470a629b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.323114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431d728ddce047a6b7db68691b8cc864'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.326955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75f5514c3b943139e2b65b470a629b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.337582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431d728ddce047a6b7db68691b8cc864'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.347984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 996/1963] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:17 2022] DELETE /identity/v3/users/431d728ddce047a6b7db68691b8cc864 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:17.348164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ab7d0148-113b-4bd5-aa77-b7f1112a9a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75f5514c3b943139e2b65b470a629b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.348268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:17.348268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:17.385835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 968/1964] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:17 2022] DELETE /identity/v3/users/c75f5514c3b943139e2b65b470a629b8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:17.392442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.392891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.393383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.423211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:17.424862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:17.468343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:17.498808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dd4ac-4762-4694-b52c-d41064a0a5a3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:17.507655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:17.569075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 969/1965] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:17.584254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:17.587266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:17.647526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:17.648185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.648531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.648950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] PATH_INFO: `/v3/projects/16a60c478cec4f14910d6c18c861437e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.650299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a60c478cec4f14910d6c18c861437e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:17.654773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:17.715699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06903b8-8de0-4376-86f3-ed63f1ecdf94 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:17.726548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:17.727753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.728483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.729905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.765773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:17.767720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c782e-f739-4ed6-9b86-1e566b391bd8 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:17.775118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a60c478cec4f14910d6c18c861437e', 'request_id': 'req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.785634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a60c478cec4f14910d6c18c861437e', 'request_id': 'req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.815857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 970/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:17.820066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a60c478cec4f14910d6c18c861437e', 'request_id': 'req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.848765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] The token cache is being invalidate because project 16a60c478cec4f14910d6c18c861437e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:17.849061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.852863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fb6684ec-3e97-4d57-8732-a0b51f5ae7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:17.861713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 997/1967] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:17 2022] DELETE /identity/v3/projects/16a60c478cec4f14910d6c18c861437e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:17.863898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:17.864391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:17.864774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:17.897007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:17.898967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.002282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 971/1968] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:18.009486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.009995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.010103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.033812 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:18.035985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.053055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 998/1969] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:18.054455 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.054674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.061675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.073854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0a72-4930-470e-aa25-b4b2d935048d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.076490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354b3c-5eb1-4383-b999-f9b1a42b1fc8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.079743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.080479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.080866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.081787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.083081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.083217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:18.083793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.084145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.084258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.084379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] PATH_INFO: `/v3/projects/918df7813e60451d8d6a3869e227e778` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.086126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=918df7813e60451d8d6a3869e227e778)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.086549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.087992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.128560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 972/1970] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:18.133248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.158413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103961e2-e5f1-4dd7-a1ca-451ee249d6a6 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.193719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918df7813e60451d8d6a3869e227e778', 'request_id': 'req-ad44eb98-0bf9-4c17-a116-8a613427a39c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.210919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918df7813e60451d8d6a3869e227e778', 'request_id': 'req-ad44eb98-0bf9-4c17-a116-8a613427a39c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.224282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918df7813e60451d8d6a3869e227e778', 'request_id': 'req-ad44eb98-0bf9-4c17-a116-8a613427a39c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.244875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] The token cache is being invalidate because project 918df7813e60451d8d6a3869e227e778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:18.245229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.245900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ad44eb98-0bf9-4c17-a116-8a613427a39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.249191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 999/1971] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:18 2022] DELETE /identity/v3/projects/918df7813e60451d8d6a3869e227e778 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:18.254408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077665b-df8f-4074-a56f-50c420b2b5db None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.254819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077665b-df8f-4074-a56f-50c420b2b5db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.255190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077665b-df8f-4074-a56f-50c420b2b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.263705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.264904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.265342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.265810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.266118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:18.266805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.268922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.317793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e077665b-df8f-4074-a56f-50c420b2b5db None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:18.317793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e077665b-df8f-4074-a56f-50c420b2b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.323417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1000/1972] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:18.332457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.333100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.333511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.348649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 973/1973] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:18.349622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.355833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.360632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:18.362978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:18.363578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.473187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779364f-609a-400e-a640-d0547713efe8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.479171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.479807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.480081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.480406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.481044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.483851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1001/1974] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:18.484507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.484853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.486143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.500956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed322a1-40b2-4b5a-a4fb-c726ec22af81 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.506939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.507600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.508088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.508368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] PATH_INFO: `/v3/projects/23f83e64eab246299d50db7b26759e28` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.509830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f83e64eab246299d50db7b26759e28)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.512039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.514836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 974/1975] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:18.515923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.538235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb3ef7-281e-4371-9987-5d8d06b4f16e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.550143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.550878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.551161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.551439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.552215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:18.552533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.554267 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.603528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 975/1976] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:18.604486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.616177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d70ff-56aa-4f0d-96d1-d431c8823ecc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.632274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f83e64eab246299d50db7b26759e28', 'request_id': 'req-ba702970-e0cf-44d3-b10f-42aa0a483135'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.641069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f83e64eab246299d50db7b26759e28', 'request_id': 'req-ba702970-e0cf-44d3-b10f-42aa0a483135'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.647474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f83e64eab246299d50db7b26759e28', 'request_id': 'req-ba702970-e0cf-44d3-b10f-42aa0a483135'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.667697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] The token cache is being invalidate because project 23f83e64eab246299d50db7b26759e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:18.668213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.669463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:18.675544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1002/1977] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:18 2022] DELETE /identity/v3/projects/23f83e64eab246299d50db7b26759e28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:18.676613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.677937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.704526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.705143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.705431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.705839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.706524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.708130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de207f03-7c98-4086-b29a-3596155583c5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.719359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 976/1978] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:18.720530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d589b-e84e-407f-8b69-674247436808 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.720824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d589b-e84e-407f-8b69-674247436808 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.721104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d589b-e84e-407f-8b69-674247436808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.741071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b42d589b-e84e-407f-8b69-674247436808 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:18.742307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b42d589b-e84e-407f-8b69-674247436808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.746531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702970-e0cf-44d3-b10f-42aa0a483135 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.757113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 977/1979] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:18.757113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d589b-e84e-407f-8b69-674247436808 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.757353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.757353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.757547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b42d589b-e84e-407f-8b69-674247436808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.757633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.757633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.757633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.757633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.764695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d589b-e84e-407f-8b69-674247436808 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.769666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.770303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.770586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.770882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.771547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.773165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4cf29-d82f-4dbf-a2ec-d8164cd74e14 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.784360 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 978/1980] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:18.786693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1003/1981] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:18.788013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.788330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.788685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.790691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.797635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:18.813189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:18.814465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:18.865345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05145bb8-b3d6-4e0e-bce1-fb88a18d4462 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.870833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.871679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.872446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.873135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.874076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.876168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.877543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:18.891725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 979/1982] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:18.892544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.900798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1004/1983] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/users => generated 305 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:18.902069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.916049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7795-02fd-4a28-9f99-5a5d60eb460f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.921787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.922563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.922900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.923181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.923923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:18.924238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.925755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab952f4-f89a-4b5b-87ac-a17935109709 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.926125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.933808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.935223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.935629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.936003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] PATH_INFO: `/v3/projects/acbf73e56a674e84a3ce16959144099e/users/d093ed0d085246cab379ee5414ebc78d/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.945975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1005/1984] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:18.945975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:18.953465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbf73e56a674e84a3ce16959144099e, user_id=d093ed0d085246cab379ee5414ebc78d, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.956443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.961958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5df44-d32d-4767-be1c-ff5a18924eeb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:18.968635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:18.969249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:18.969526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:18.969793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:18.970649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:18.973085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:18.988782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1006/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:18.988782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.000440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5f45b-6b24-4f62-86e5-5d48a43339ee admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.012037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 980/1986] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:18 2022] PUT /identity/v3/projects/acbf73e56a674e84a3ce16959144099e/users/d093ed0d085246cab379ee5414ebc78d/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:19.013327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.092600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274639d-0202-465e-9256-b9df19d7d0b0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.097691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.098517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.098982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.099403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.100625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.101204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.102182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.102592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.103412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ad23d-f99a-47a4-9c3f-e229cdbd203d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.103669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.104965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.108462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.125968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 981/1987] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:19.127298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.127641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.127914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.149721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1007/1988] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:18 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.155274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.197342 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] MFA Rules not processed for user `d093ed0d085246cab379ee5414ebc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:19.198656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:19.245016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:19.251692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f81c9-99c2-4406-aaea-a2d4c9abb457 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.259146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.260032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.260315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.260751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] PATH_INFO: `/v3/projects/c6d63d7d0d9947d795eaf9eb56fc2a55/users/f9421fcc6e2a464baea3bd4de57a30a6/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.275367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 982/1989] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:19.276203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.277054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d63d7d0d9947d795eaf9eb56fc2a55, user_id=f9421fcc6e2a464baea3bd4de57a30a6, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.280628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.287952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf5be2-f473-467a-a21a-5809b814a154 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.306426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1008/1990] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:19 2022] PUT /identity/v3/projects/c6d63d7d0d9947d795eaf9eb56fc2a55/users/f9421fcc6e2a464baea3bd4de57a30a6/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:19.306426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.362366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.363076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.363430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.363773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.364479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.366668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4f645-d3c0-4f68-b626-7a7c1a7b0269 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.371616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be21546-fa34-416d-8c0e-d00df46403ce admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.376997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:19.378258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.378664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.378989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.379269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.379925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.382684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.394470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 983/1991] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.398762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.399248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.399519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.421013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1009/1992] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.421772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.448818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] MFA Rules not processed for user `f9421fcc6e2a464baea3bd4de57a30a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:19.450689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:19.511583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d211-ffd6-461f-bd7c-67e471f53e49 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.517276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.518296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.518577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.519859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.520680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.523954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.530624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 984/1993] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:19.531531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.537619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1010/1994] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:19.538464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.543115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50a231-bcfb-4447-bf63-05cd2c0fa3e1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.549047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.549740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.549856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e8223-765c-4080-a1b9-132bed47e3d4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.550136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.550502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.551214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.553609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.555231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.555850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.556130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.556398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.557039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.558976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.589815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 985/1995] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/users => generated 295 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.589815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.601089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853fcce-55b0-4428-9848-850fa62dc408 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.606202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.607218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.607754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.608119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.608915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.611428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.626244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 986/1996] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:19.627722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.644576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd32c-1613-469f-8dcc-06b20068f6a7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.652965 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.653629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.653945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.654253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.658028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1011/1997] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.658381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.658561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.658646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.672739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 987/1998] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:19.672739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.681543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db08d6-3099-4aae-9cc7-ba7ef9e5da46 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.726828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:19.760066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bda40-4746-4261-b3e6-c21123b79834 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.766795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.767682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.768149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.768592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] PATH_INFO: `/v3/projects/8ea9d461eb0c4f9bb53e5286a06f019a/users/339d183d10404b3783fc7fd3e8573b3d/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.778242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.778878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.779150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.779518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.780189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.782484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d76264-f44d-4af6-9e82-4008427addbc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.789727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea9d461eb0c4f9bb53e5286a06f019a, user_id=339d183d10404b3783fc7fd3e8573b3d, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.792747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.818181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1012/1999] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:19 2022] PUT /identity/v3/projects/8ea9d461eb0c4f9bb53e5286a06f019a/users/339d183d10404b3783fc7fd3e8573b3d/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:19.823345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.830155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 988/2000] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:19.831569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931219-f910-49ac-81fc-80824c05271f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.831856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931219-f910-49ac-81fc-80824c05271f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.832133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0931219-f910-49ac-81fc-80824c05271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.874918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d0931219-f910-49ac-81fc-80824c05271f None None] MFA Rules not processed for user `339d183d10404b3783fc7fd3e8573b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:19.874918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d0931219-f910-49ac-81fc-80824c05271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:19.906748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:19.937718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6786-6b9c-4fea-b201-bb8abe6a3de9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.943702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.944462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.944742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.945110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] PATH_INFO: `/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20/users/cd8d00fffa874e0ab4b8703241bb7795/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.963268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 989/2001] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:19.963268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931219-f910-49ac-81fc-80824c05271f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:19.971727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0abcefe88bd4bb8b063f820d3b50e20, user_id=cd8d00fffa874e0ab4b8703241bb7795, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.974868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0931219-f910-49ac-81fc-80824c05271f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:19.975005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.979813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:19.980418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:19.980690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:19.980989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:19.982151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:19.983912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:19.991485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1013/2002] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:19 2022] PUT /identity/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20/users/cd8d00fffa874e0ab4b8703241bb7795/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:19.998890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 990/2003] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:19.999543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.003002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.014131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77612d-0932-4192-9ac7-ade5d0315f51 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.090660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a829067-d9d2-41bf-882e-4e680e3133cf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.098979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.099688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.100015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.100338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.101225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.103291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.104495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.105214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.105596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.105942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.107336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.109024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.120954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 991/2004] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:20.121924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.133434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38743-59df-4b09-bd38-d3b4d48abed7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.140716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1014/2005] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:19 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:20.140855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.140990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.141079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.141079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.141079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] PATH_INFO: `/v3/projects/5f98688351a94e7ead4aeabf231fd8bf/users/4d32bdb416f04f5b99927713f210a0fc/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.154897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f98688351a94e7ead4aeabf231fd8bf, user_id=4d32bdb416f04f5b99927713f210a0fc, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.157550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.171611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 992/2006] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:20 2022] PUT /identity/v3/projects/5f98688351a94e7ead4aeabf231fd8bf/users/4d32bdb416f04f5b99927713f210a0fc/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:20.172698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.175210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:20.212919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e07515-99a5-4d53-b0a6-1f08f59f9d49 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.248318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca256-82c3-45a4-a73f-f70fc7620340 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.254642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.255381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.256132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.256478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.257190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.261928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.277278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.278056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.278967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.279247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] PATH_INFO: `/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20/users/cd8d00fffa874e0ab4b8703241bb7795/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.281381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0abcefe88bd4bb8b063f820d3b50e20, user_id=cd8d00fffa874e0ab4b8703241bb7795, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.284341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.286612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 993/2007] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:20 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:20.287602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.300132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1015/2008] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:20 2022] PUT /identity/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20/users/cd8d00fffa874e0ab4b8703241bb7795/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:20.301404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.301545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c94e4-5b35-483b-b071-8987efde4dc0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.316898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:20.374627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.375945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.376401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.376512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.377136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.378792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ca81-2311-44b7-be9d-d5dac4e08687 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.399789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94738bd5-5818-431d-b20b-2828ca808520 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.406584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 994/2009] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:20.408069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187507-1764-439b-84d9-acf932672505 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.408420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187507-1764-439b-84d9-acf932672505 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.408766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc187507-1764-439b-84d9-acf932672505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.410956 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.411835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.412287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.412695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.413478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.415362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.432371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1016/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:20.432371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.448741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58a512-eb97-47ad-8796-b944106a42e5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.449054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fc187507-1764-439b-84d9-acf932672505 None None] MFA Rules not processed for user `cd8d00fffa874e0ab4b8703241bb7795`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:20.450670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fc187507-1764-439b-84d9-acf932672505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:20.454162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.454905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.455192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.455967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] PATH_INFO: `/v3/projects/5f98688351a94e7ead4aeabf231fd8bf/users/4d32bdb416f04f5b99927713f210a0fc/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.457704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f98688351a94e7ead4aeabf231fd8bf, user_id=4d32bdb416f04f5b99927713f210a0fc, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.461479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.486267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1017/2011] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:20 2022] PUT /identity/v3/projects/5f98688351a94e7ead4aeabf231fd8bf/users/4d32bdb416f04f5b99927713f210a0fc/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:20.486267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.554642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 995/2012] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:20.554642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.554642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.554642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.597025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] MFA Rules not processed for user `4d32bdb416f04f5b99927713f210a0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:20.598373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:20.636545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:20.650727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a38373-6688-43d0-8d39-18e08812904b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.663954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.664705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.665057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.665398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.666121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.667961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.684179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1018/2013] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:20.684179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.686886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:20.688901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 996/2014] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:20.689846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.700428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d01e4-0efd-4cff-b7e1-6aa4fcb883f1 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.706258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.706258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.706258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.706567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] PATH_INFO: `/v3/projects/bcd3805557d74147905e484e9ac8d9bc/users/013afbbcb79b409bbc06382c45f49eaa/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.721407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd3805557d74147905e484e9ac8d9bc, user_id=013afbbcb79b409bbc06382c45f49eaa, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.724242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.726513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:20.739144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 997/2015] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:20 2022] PUT /identity/v3/projects/bcd3805557d74147905e484e9ac8d9bc/users/013afbbcb79b409bbc06382c45f49eaa/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:20.739728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:20.741275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:20.758500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749819f2-3093-4583-a83a-ec9ddb2c8529 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.805215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe5ed5-d560-48d5-a70f-422f5572d4aa admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:20.807740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.808360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.808642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.808872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:20.809031 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.810028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.810347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.810622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.876727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.878171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f8194-3df8-496f-afee-39dd0e9f4f69 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.885144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:20.886612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:20.887384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1019/2016] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:20.888762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:20.889052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:20.889330 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:20.902957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 998/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:20.919493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] MFA Rules not processed for user `013afbbcb79b409bbc06382c45f49eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:20.920731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:20.980140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:21.006820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1020/2018] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:21.022773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.137704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d622f-aa2a-42b0-86cc-f8c342b53306 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.146864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.147674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.148089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.148647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.149618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.152658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.209876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 999/2019] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:21 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:21.213476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.229233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9ddc-af00-4da3-a1c5-59b3646e1f33 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.258908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.350194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:21.369327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.370558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.373277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.373657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.374792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.380050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.408579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2e3fb-63a5-4bd4-85b0-c7d7b75d4500 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.421496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.422145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.422453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.422731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.433385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1021/2020] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:21 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:21.437977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.467269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02a323-d04c-4f32-987e-ac6b13744ef8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.489173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.491304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.491573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.491850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.492691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.496292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.528097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1022/2021] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:21.536713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.563132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5e07d-7c8f-4cdd-acbf-0dd651a8bc74 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.582457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.584554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.584843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.586410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] PATH_INFO: `/v3/projects/bf686e3c21be46c8a67179fa84134415/users/e1685bfcff394d59a82742dd82c15896/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.596932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.599464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.611578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf686e3c21be46c8a67179fa84134415, user_id=e1685bfcff394d59a82742dd82c15896, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.612459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1000/2022] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:21 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:21.614965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.657010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1023/2023] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:21 2022] PUT /identity/v3/projects/bf686e3c21be46c8a67179fa84134415/users/e1685bfcff394d59a82742dd82c15896/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:21.661007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.678820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3beba-1537-427d-b724-3901e36e8a74 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.781847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.782589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.782908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.783174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.783881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.787958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d426-eab6-48cf-b77c-a041cb26c62f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.814181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1001/2024] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:21.818079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:21.847126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a171-a58a-448e-b5df-5c4960d301f7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:21.859540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:21.862894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.863939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.866612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] PATH_INFO: `/v3/projects/bf686e3c21be46c8a67179fa84134415/users/e1685bfcff394d59a82742dd82c15896/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.869321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf686e3c21be46c8a67179fa84134415, user_id=e1685bfcff394d59a82742dd82c15896, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:21.872777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:21.906672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1024/2025] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:21 2022] PUT /identity/v3/projects/bf686e3c21be46c8a67179fa84134415/users/e1685bfcff394d59a82742dd82c15896/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:21.907334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:21.907790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:21.908296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:21.974597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] MFA Rules not processed for user `e1685bfcff394d59a82742dd82c15896`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:21.975850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:22.217189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1002/2026] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:22.242243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:22.324149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644966f-cce8-48c0-8958-f6e37be0635a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:22.329185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:22.329945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:22.330353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:22.330668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:22.380563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:22.394910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:22.396342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:22.406389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1025/2027] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:23.791748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:23.797939 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:23.802057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb604043-82e8-4af7-a4ae-9c15bafb1d4c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:23.806301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:23.806996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:23.807346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:23.807628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:23.988047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:23.990356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:24.007344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1003/2028] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:25.135981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:25.149146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c74a1-3c1a-4f58-a5fa-545118b8df2a service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:25.164972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed780-315b-4301-b058-270aed11490f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:25.166679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed780-315b-4301-b058-270aed11490f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:25.166963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed780-315b-4301-b058-270aed11490f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:25.167244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed780-315b-4301-b058-270aed11490f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:25.230270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed780-315b-4301-b058-270aed11490f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:25.232648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed780-315b-4301-b058-270aed11490f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:25.242104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1026/2029] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:26.111745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:26.124754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c368c7-aeab-46ff-af43-1a8283a3c797 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:26.130151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:26.131251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:26.131830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:26.132245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:26.156264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:26.156464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a60b7-ab07-4037-90e8-43dc3f7bb471 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:26.172450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1004/2030] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:29.895009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed780-315b-4301-b058-270aed11490f service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:29.959130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed780-315b-4301-b058-270aed11490f service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:29.963594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:29.964216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:29.964495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:29.964771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] PATH_INFO: `/v3/users/f9421fcc6e2a464baea3bd4de57a30a6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:29.966968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9421fcc6e2a464baea3bd4de57a30a6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:29.968922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:30.018564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9421fcc6e2a464baea3bd4de57a30a6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.019294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9421fcc6e2a464baea3bd4de57a30a6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.027006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9421fcc6e2a464baea3bd4de57a30a6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.039494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9421fcc6e2a464baea3bd4de57a30a6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.046735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9421fcc6e2a464baea3bd4de57a30a6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.052930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1027/2031] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:29 2022] DELETE /identity/v3/users/f9421fcc6e2a464baea3bd4de57a30a6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:30.057612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:30.058067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:30.058317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:30.084534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:30.084534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:30.146350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1005/2032] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:30.156741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:30.158275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:30.164082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:30.248041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de52116-e5da-4035-abbd-23515d9beb23 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:30.252412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:30.253332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:30.253619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:30.253890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:30.266143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:30.267739 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:30.279887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1028/2033] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:30.661948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:30.663570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:30.677598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6716-8b40-4004-9a82-30b3ff80b042 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:30.682476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:30.683242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:30.683390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:30.683834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] PATH_INFO: `/v3/projects/c6d63d7d0d9947d795eaf9eb56fc2a55` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:30.686042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d63d7d0d9947d795eaf9eb56fc2a55)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:30.688435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:30.758928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d63d7d0d9947d795eaf9eb56fc2a55', 'request_id': 'req-edb036ec-8192-41ff-80d7-38b1e2224e77'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.765548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d63d7d0d9947d795eaf9eb56fc2a55', 'request_id': 'req-edb036ec-8192-41ff-80d7-38b1e2224e77'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.771868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d63d7d0d9947d795eaf9eb56fc2a55', 'request_id': 'req-edb036ec-8192-41ff-80d7-38b1e2224e77'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.785209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] The token cache is being invalidate because project c6d63d7d0d9947d795eaf9eb56fc2a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:30.785503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.786126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.787730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1006/2034] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:30 2022] DELETE /identity/v3/projects/c6d63d7d0d9947d795eaf9eb56fc2a55 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:30.791884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:30.802023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b948ac-345e-4d35-b6e6-2ce639205af9 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:30.858686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:30.859358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:30.859599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:30.859872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] PATH_INFO: `/v3/users/4d32bdb416f04f5b99927713f210a0fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:30.861036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d32bdb416f04f5b99927713f210a0fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:30.863014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:30.909817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d32bdb416f04f5b99927713f210a0fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.910495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d32bdb416f04f5b99927713f210a0fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.919550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d32bdb416f04f5b99927713f210a0fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.932896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d32bdb416f04f5b99927713f210a0fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.940769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5ed6e399-27e6-4586-b3dc-a9c1548ca5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d32bdb416f04f5b99927713f210a0fc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:30.946982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1029/2035] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:30 2022] DELETE /identity/v3/users/4d32bdb416f04f5b99927713f210a0fc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:31.261478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.263540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.278197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb036ec-8192-41ff-80d7-38b1e2224e77 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.284552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:31.340433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.342161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.342475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.342754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] PATH_INFO: `/v3/projects/5f98688351a94e7ead4aeabf231fd8bf` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.343897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f98688351a94e7ead4aeabf231fd8bf)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.345830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.392953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f98688351a94e7ead4aeabf231fd8bf', 'request_id': 'req-092ce78d-87a0-427b-9580-0d23491a0984'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.399362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f98688351a94e7ead4aeabf231fd8bf', 'request_id': 'req-092ce78d-87a0-427b-9580-0d23491a0984'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.405754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f98688351a94e7ead4aeabf231fd8bf', 'request_id': 'req-092ce78d-87a0-427b-9580-0d23491a0984'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.418011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] The token cache is being invalidate because project 5f98688351a94e7ead4aeabf231fd8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:31.418334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.418986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.420577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1007/2036] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:31 2022] DELETE /identity/v3/projects/5f98688351a94e7ead4aeabf231fd8bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:31.426945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76fdf-9225-4ee7-a442-db556488cfc9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.427243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76fdf-9225-4ee7-a442-db556488cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.427514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e76fdf-9225-4ee7-a442-db556488cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.448603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a2e76fdf-9225-4ee7-a442-db556488cfc9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:31.449413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a2e76fdf-9225-4ee7-a442-db556488cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.476022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:31.542906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.544305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.551059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1030/2037] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:31.553171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.553539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.553894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.561630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ce78d-87a0-427b-9580-0d23491a0984 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.566951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.567717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.568198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.568537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] PATH_INFO: `/v3/users/339d183d10404b3783fc7fd3e8573b3d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.570183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339d183d10404b3783fc7fd3e8573b3d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.572205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.583914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:31.585645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.594804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1031/2038] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:31.599128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.608542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd2a1-bd76-4e35-bbc0-41070494390c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.616650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.617607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.617962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.618578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.619483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:31.619982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.622196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.638458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1032/2039] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:31.647695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.653325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339d183d10404b3783fc7fd3e8573b3d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.654636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339d183d10404b3783fc7fd3e8573b3d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.655688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339d183d10404b3783fc7fd3e8573b3d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.664692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339d183d10404b3783fc7fd3e8573b3d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.667233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d168122-95dd-4499-93d7-88a1fb25960a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.678452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.678452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.678452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.678452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.678740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.678740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.686760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-fb252248-f4d0-4610-9166-bf0c56967c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339d183d10404b3783fc7fd3e8573b3d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:31.702765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1008/2040] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:31 2022] DELETE /identity/v3/users/339d183d10404b3783fc7fd3e8573b3d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:31.707110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.707396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.707672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.709367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1033/2041] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:31 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:31.713227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.715993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.727836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:31.729056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.735283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:31.802903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7471fd2-38bf-40f5-9838-a93edef0475c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.808659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.809277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.809699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.809980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.810656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.812122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1009/2042] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:31.815908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.832078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.834290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:31.866387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1034/2043] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:31 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:31.867685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.881209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ed69c-0e74-4887-8c70-66aee9430b80 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.887934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.889397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.889888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.890800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.892763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.894744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.908230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e083-34bd-4c1e-a381-c90dd19992bc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.916063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1035/2044] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:31.927191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.928729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.929390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.929670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.929943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.937732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23a09-dd8f-4cdb-be25-b978422597a3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.943245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.943859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.944258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.944362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.944540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.945228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:31.945807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.946826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bade559-e00d-438f-b409-b15a50b0292d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:31.956968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1010/2045] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:31.960718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1036/2046] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:31.964814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:31.975935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafaf4b-2b23-404d-9a15-1e7b9e60d288 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:31.981069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:31.981815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:31.982170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:31.982841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] PATH_INFO: `/v3/projects/302c985af39145ec871f4f1f783fe936/users/f614db2c87084c52be1212a2a4b7a896/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:31.999807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=302c985af39145ec871f4f1f783fe936, user_id=f614db2c87084c52be1212a2a4b7a896, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:32.002545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:32.030274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1011/2047] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:31 2022] PUT /identity/v3/projects/302c985af39145ec871f4f1f783fe936/users/f614db2c87084c52be1212a2a4b7a896/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:32.031089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:32.031382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:32.031664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:32.063848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] MFA Rules not processed for user `f614db2c87084c52be1212a2a4b7a896`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:32.065195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:32.124826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:32.174876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1037/2048] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:32.186783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:32.188786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:32.258551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399f569-3f43-42b2-ab72-29f342a104ff admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:32.262602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:32.263205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:32.263689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:32.263870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:32.274995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:32.276539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:32.289358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1012/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:32.361291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:32.363793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:32.443397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d8ad9-4a59-4456-8feb-c2763d2e9aaf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:32.449541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:32.450459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:32.450745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:32.451022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] PATH_INFO: `/v3/projects/8ea9d461eb0c4f9bb53e5286a06f019a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:32.452239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea9d461eb0c4f9bb53e5286a06f019a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:32.454359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:32.507081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea9d461eb0c4f9bb53e5286a06f019a', 'request_id': 'req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.513396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea9d461eb0c4f9bb53e5286a06f019a', 'request_id': 'req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.521458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea9d461eb0c4f9bb53e5286a06f019a', 'request_id': 'req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.537767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] The token cache is being invalidate because project 8ea9d461eb0c4f9bb53e5286a06f019a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:32.538339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.538985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.540577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1038/2050] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:32 2022] DELETE /identity/v3/projects/8ea9d461eb0c4f9bb53e5286a06f019a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:32.544629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:32.570813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43089989-5ff8-4a5c-9f9d-ff2addd9c00f service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:32.610430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:32.643026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:32.643687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:32.643968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:32.644271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] PATH_INFO: `/v3/users/013afbbcb79b409bbc06382c45f49eaa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:32.645561 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013afbbcb79b409bbc06382c45f49eaa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:32.647585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:32.695171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013afbbcb79b409bbc06382c45f49eaa'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.695821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013afbbcb79b409bbc06382c45f49eaa'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.696429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013afbbcb79b409bbc06382c45f49eaa'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.707800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013afbbcb79b409bbc06382c45f49eaa'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.720714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013afbbcb79b409bbc06382c45f49eaa'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:32.735430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1013/2051] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:32 2022] DELETE /identity/v3/users/013afbbcb79b409bbc06382c45f49eaa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:33.019134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:33.020644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.039892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfdde7-f91b-45ce-b6ca-8aec091e6cc6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:33.109166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:33.109813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.110094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.110399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] PATH_INFO: `/v3/projects/bcd3805557d74147905e484e9ac8d9bc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.111532 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd3805557d74147905e484e9ac8d9bc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:33.113534 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:33.126029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:33.161509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd3805557d74147905e484e9ac8d9bc', 'request_id': 'req-5a4aad0a-6c2d-42b2-92dd-b24627330426'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.167646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd3805557d74147905e484e9ac8d9bc', 'request_id': 'req-5a4aad0a-6c2d-42b2-92dd-b24627330426'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.173793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd3805557d74147905e484e9ac8d9bc', 'request_id': 'req-5a4aad0a-6c2d-42b2-92dd-b24627330426'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.187062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] The token cache is being invalidate because project bcd3805557d74147905e484e9ac8d9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:33.187349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.187975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.189446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1039/2052] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:33 2022] DELETE /identity/v3/projects/bcd3805557d74147905e484e9ac8d9bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:33.193375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:33.194825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.207483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5ea-baea-4732-b363-58a2ff7e62f4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:33.264788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:33.265447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.265700 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.265976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] PATH_INFO: `/v3/users/e1685bfcff394d59a82742dd82c15896` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.267171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1685bfcff394d59a82742dd82c15896)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:33.269087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:33.324990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:33.325731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1685bfcff394d59a82742dd82c15896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.328323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1685bfcff394d59a82742dd82c15896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.328450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.329855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1685bfcff394d59a82742dd82c15896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.338434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:33.339542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1685bfcff394d59a82742dd82c15896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.354687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4aad0a-6c2d-42b2-92dd-b24627330426 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:33.363508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:33.364253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.364608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.365098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] PATH_INFO: `/v3/users/6f81093c7df44a5baa561175470ef8d5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.366247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f81093c7df44a5baa561175470ef8d5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:33.368315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:33.375416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b9f43515-bca0-49bd-8d0e-3f2b47ead239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1685bfcff394d59a82742dd82c15896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.400194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1014/2053] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:33 2022] DELETE /identity/v3/users/e1685bfcff394d59a82742dd82c15896 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:33.435649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f81093c7df44a5baa561175470ef8d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.436456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f81093c7df44a5baa561175470ef8d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.444002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f81093c7df44a5baa561175470ef8d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.457523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f81093c7df44a5baa561175470ef8d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.472228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f81093c7df44a5baa561175470ef8d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:33.479269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1040/2054] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:33 2022] DELETE /identity/v3/users/6f81093c7df44a5baa561175470ef8d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:33.484911 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.485279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.485625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.505399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:33.506770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.601844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1015/2055] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:33.613668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:33.616000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.698567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef4ba1-611f-44a3-bb83-d9152dbc7123 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:33.708629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:33.709333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.709611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.709928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.721746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:33.723223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf13ab-c81e-4b7b-adc1-e1769d925619 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:33.736273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1041/2056] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:33.934470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:33.936928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:33.954480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cef0c-de57-4c17-8046-b2f5ec8949a4 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:33.961656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:33.962413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:33.962698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:33.962991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] PATH_INFO: `/v3/projects/bf686e3c21be46c8a67179fa84134415` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:33.964560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf686e3c21be46c8a67179fa84134415)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:33.968025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.037586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf686e3c21be46c8a67179fa84134415', 'request_id': 'req-4d7f2099-0d39-439c-bc6b-d06325e01b27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.048613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf686e3c21be46c8a67179fa84134415', 'request_id': 'req-4d7f2099-0d39-439c-bc6b-d06325e01b27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.062692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf686e3c21be46c8a67179fa84134415', 'request_id': 'req-4d7f2099-0d39-439c-bc6b-d06325e01b27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.094066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] The token cache is being invalidate because project bf686e3c21be46c8a67179fa84134415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:34.094066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.094953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4d7f2099-0d39-439c-bc6b-d06325e01b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.098260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1016/2057] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:33 2022] DELETE /identity/v3/projects/bf686e3c21be46c8a67179fa84134415 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:34.102579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.103072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.103274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.156716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:34.158190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:34.183084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:34.269924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1042/2058] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:34.280464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.280975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.281627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.312354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:34.315319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:34.344344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1017/2059] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:34.350421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.377824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca355844-f65e-4147-b84e-cd667f9303c3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.391650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.398071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.399092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.399313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.401333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:34.401653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.405632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.433306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.442010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1043/2060] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:34.445976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6603a5d-bffd-4cf6-9273-a86754d09a54 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.460112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.460821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.461180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.461510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.462246 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.464312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.506507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1018/2061] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:34.507105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.519743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5fde4-9bc8-488a-a691-c1735dd729b3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.582685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.585305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:34.612390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.613663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.614087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.615170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.617743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.621372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.658842 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1044/2062] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:34.662927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.682529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a3e5a-a7e2-46e8-90c5-2ebfdb47fcd5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.689713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:34.694370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.695447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.695891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.696186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.697335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.699626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.715359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1045/2063] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:34.719655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.733640 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b178-4b8b-4477-9604-9daf399d4d11 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.741875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.742537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.742822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.743104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.743769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.745438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.762302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1046/2064] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:34.763626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:34.780490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845de350-016e-4eae-a5a2-30eef831178b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.792409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.793605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.793954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.798529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010e465-ee6c-4899-9695-17842db68b73 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:34.798766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] PATH_INFO: `/v3/projects/a37f4f6a2f0b4997a64e719944e56adb` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.800248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37f4f6a2f0b4997a64e719944e56adb)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.802833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.809224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:34.809924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.810299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.810681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] PATH_INFO: `/v3/projects/916a821948114782b4535c92db12c39e/users/d4ca6dd971cd461c8fc79178cd726ce7/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.854635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] RBAC: Authorizing `identity:create_grant(project_id=916a821948114782b4535c92db12c39e, user_id=d4ca6dd971cd461c8fc79178cd726ce7, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:34.858831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1deaea-82ae-40e6-b52d-4ad8b48372db admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:34.899275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1047/2065] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:34 2022] PUT /identity/v3/projects/916a821948114782b4535c92db12c39e/users/d4ca6dd971cd461c8fc79178cd726ce7/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:34.905865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.906626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.906837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:34.916669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37f4f6a2f0b4997a64e719944e56adb', 'request_id': 'req-6833ef76-d74b-4445-874c-e2eaa498921d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.933338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37f4f6a2f0b4997a64e719944e56adb', 'request_id': 'req-6833ef76-d74b-4445-874c-e2eaa498921d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.944341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37f4f6a2f0b4997a64e719944e56adb', 'request_id': 'req-6833ef76-d74b-4445-874c-e2eaa498921d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.968547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] The token cache is being invalidate because project a37f4f6a2f0b4997a64e719944e56adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:34.968877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.969519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6833ef76-d74b-4445-874c-e2eaa498921d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:34.971526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1019/2066] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:34 2022] DELETE /identity/v3/projects/a37f4f6a2f0b4997a64e719944e56adb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:34.972199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] MFA Rules not processed for user `d4ca6dd971cd461c8fc79178cd726ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:34.973498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:34.976361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5440bd-d762-406e-9938-39778ea99396 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:34.976651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5440bd-d762-406e-9938-39778ea99396 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:34.976930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5440bd-d762-406e-9938-39778ea99396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.001138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8e5440bd-d762-406e-9938-39778ea99396 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:35.002416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8e5440bd-d762-406e-9938-39778ea99396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.029026 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:35.087969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1048/2067] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:35.099115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1020/2068] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:35.101242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.103057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.106739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.107228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.107503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.134520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:35.135764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.148639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1021/2069] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:35.152268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.163044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8b911-0ada-43a0-983c-dfcc65dda44a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.168458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.169165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.169520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.169861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.171173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:35.171882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.174027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.189516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1022/2070] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:35.194137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.197535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da691a-2ac2-4044-8f01-5d0e8690a0ef None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.207032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.207741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.208008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.208440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.216334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d4f3-dcdb-4c8c-991e-e15bc0e61ecd admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.228776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.231077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.231361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.231631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.232298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.235905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.238230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.244432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.251367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1049/2071] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:35.298353 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1023/2072] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:35.302871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.318497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ff4fb-1ef3-4cf7-ba51-f42579b12587 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.398611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.399382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.399487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.399741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.400373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.402300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.433400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1050/2073] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:35.434370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.453313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc11ad-a05f-42b1-8fe5-f0334e0bc0bb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.477967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.478947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.480855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.481733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.482870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.486398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.504756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1024/2074] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:35.509947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.525612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd0c25-c817-4af3-a6a6-2fc2ecd33295 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.541892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.542549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.542831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.543184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.543854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.545713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06b5d1-b290-4031-a9e9-dac7fe08bca9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.569935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1051/2075] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:35.575624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.587984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:35.595032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acac16-7921-4d92-947d-afef7014f89c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.620089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.620775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.621063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.621334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] PATH_INFO: `/v3/projects/46a1b8bdaa034580b21a2a68db49f622/users/62023485417f48948ff4bbe5be3fc2d7/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.660127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a1b8bdaa034580b21a2a68db49f622, user_id=62023485417f48948ff4bbe5be3fc2d7, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.667106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.688347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1025/2076] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:35 2022] PUT /identity/v3/projects/46a1b8bdaa034580b21a2a68db49f622/users/62023485417f48948ff4bbe5be3fc2d7/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:35.700438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.701005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.701750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.763091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] MFA Rules not processed for user `62023485417f48948ff4bbe5be3fc2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:35.764744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.765444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.768383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.866459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:35.886470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cea36-6b87-4a17-8b14-2fd9fb21ade7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.892495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.893216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.893496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.893765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] PATH_INFO: `/v3/users/f614db2c87084c52be1212a2a4b7a896` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.894880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f614db2c87084c52be1212a2a4b7a896)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.898652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1052/2077] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:35.898806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.900199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.916157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363068d1-b058-4f98-b45f-98bb9b308f9b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:35.925612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:35.926470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:35.926783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:35.927427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:35.928059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:35.931697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:35.962724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f614db2c87084c52be1212a2a4b7a896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:35.963846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f614db2c87084c52be1212a2a4b7a896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:35.964678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f614db2c87084c52be1212a2a4b7a896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:35.969659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1053/2078] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:35.973507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:35.975608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:35.982857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f614db2c87084c52be1212a2a4b7a896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.000403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3284e1b2-ac01-4aa0-8650-df47f49c8b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f614db2c87084c52be1212a2a4b7a896'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.018317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1026/2079] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:35 2022] DELETE /identity/v3/users/f614db2c87084c52be1212a2a4b7a896 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:36.021631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.021922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.022201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.042023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:36.043397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.051440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5b2fd-bf1f-43dc-ac20-269c3210393e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.102228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:36.113384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1027/2080] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:36.125036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.128403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.133780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.134444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.134730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.135003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.135716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.140393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.164283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1054/2081] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:35 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:36.168239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.179460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008172f7-c95d-4387-badd-fd6de7b5d9b2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.184375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.185063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.185400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.186161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.187127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.188804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.197097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca74508-1bb2-4061-a919-ab22f8201151 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.200666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1055/2082] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:36.201862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.202598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.202990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.203642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.204729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.213907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.214984 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.216208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddbf77-28fb-482c-83f6-8b7fa083c543 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.223058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.223667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.224011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.224386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.225084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.226870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1028/2083] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:36.227022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f85218-693b-49db-a89f-10a78bc96581 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.240860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1056/2084] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:36.245403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.255648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984572c6-8eba-419b-9d8b-567bd78fd3f4 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.260454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.261109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.261392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.261675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] PATH_INFO: `/v3/projects/172a62c737754751a9459f769c433de2/users/0d9c7b430b7140f1aff36c4290e090a8/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.278829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=172a62c737754751a9459f769c433de2, user_id=0d9c7b430b7140f1aff36c4290e090a8, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.282145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.299976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1029/2085] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:36 2022] PUT /identity/v3/projects/172a62c737754751a9459f769c433de2/users/0d9c7b430b7140f1aff36c4290e090a8/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:36.311254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.311570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.311847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.345329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] MFA Rules not processed for user `0d9c7b430b7140f1aff36c4290e090a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:36.347057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.383822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:36.447396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1057/2086] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:36.452270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.518673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67840-887b-4947-8086-ff1f59bd8bdc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.523748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.524361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.524653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.524928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.525613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.527742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.527884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.529510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.552578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba1b7-0c2a-45bb-9aeb-f3e0dee2365c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.558625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.559323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.559624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.560056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] PATH_INFO: `/v3/projects/302c985af39145ec871f4f1f783fe936` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.561653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] RBAC: Authorizing `identity:delete_project(project_id=302c985af39145ec871f4f1f783fe936)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.563611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.566071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1030/2087] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:36.567007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.613563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302c985af39145ec871f4f1f783fe936', 'request_id': 'req-1909516c-3e40-454c-a395-3a816f85898c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.620144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302c985af39145ec871f4f1f783fe936', 'request_id': 'req-1909516c-3e40-454c-a395-3a816f85898c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.626785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302c985af39145ec871f4f1f783fe936', 'request_id': 'req-1909516c-3e40-454c-a395-3a816f85898c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.636026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a8ea-c84e-447b-aa5d-862bb7a50066 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.640641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] The token cache is being invalidate because project 302c985af39145ec871f4f1f783fe936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:36.640931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.641967 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1909516c-3e40-454c-a395-3a816f85898c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:36.643165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1058/2088] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:36 2022] DELETE /identity/v3/projects/302c985af39145ec871f4f1f783fe936 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:36.648368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:36.649352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574307-7b9c-461f-a737-760a2aced1ca None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.649638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574307-7b9c-461f-a737-760a2aced1ca None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.649980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574307-7b9c-461f-a737-760a2aced1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.669952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-03574307-7b9c-461f-a737-760a2aced1ca None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:36.671699 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-03574307-7b9c-461f-a737-760a2aced1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.710123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.710788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.710969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.711249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.714949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.714949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.738782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1031/2089] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:36.743045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.745015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.747093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1059/2090] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:36.755138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.755528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.755750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.759072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a959d5-9762-416a-88f9-c66b7f4c43d4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.774434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.774434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.774434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.774434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.774795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.774795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.775371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:36.776575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:36.779282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1032/2091] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:36.783715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.786879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1060/2092] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:36.790900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.794575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04b313-f489-48ac-a250-c3c5c355017a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.800547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc3e27-1526-45b7-834c-0e7570837563 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.801857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.803357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.803855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.804338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] PATH_INFO: `/v3/projects/08f37a2329e84a428a42c492e867f6a8/users/daeb26b81ac5429e955339da03eb5a51/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.805239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.805829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.806103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.806413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.807058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:36.807360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.808930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.830673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1061/2093] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:36.832357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f37a2329e84a428a42c492e867f6a8, user_id=daeb26b81ac5429e955339da03eb5a51, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.839165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:36.842902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.864503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1033/2094] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:36 2022] PUT /identity/v3/projects/08f37a2329e84a428a42c492e867f6a8/users/daeb26b81ac5429e955339da03eb5a51/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:36.865800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:36.866476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15848a-2f34-4a8f-8958-66fcb94ef958 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:36.912034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:36.971053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:36.972275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:36.972846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:36.973129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:36.973766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:36.975685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.015795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9307b-632f-4456-92b5-a7589efc3636 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.026045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.026238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1062/2095] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:36 2022] POST /identity/v3/projects => generated 399 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:37.027008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.027434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.027771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.028560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.030049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.031957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.043513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1034/2096] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:37.047795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.059941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb740fff-5668-473c-acc0-02d6faa8f39c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.162344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767c33c-c98a-4053-a95d-a87a608f8d48 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.169781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.171727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.172236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.172507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.173469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.175724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.187008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.187693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.187972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.188451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] PATH_INFO: `/v3/projects/08f37a2329e84a428a42c492e867f6a8/users/daeb26b81ac5429e955339da03eb5a51/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.193739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f37a2329e84a428a42c492e867f6a8, user_id=daeb26b81ac5429e955339da03eb5a51, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.200142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c6b00-4444-40a9-b684-bb048cb45252 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.211893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:37.212866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1063/2097] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:37 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:37.218129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.238574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1035/2098] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:37 2022] PUT /identity/v3/projects/08f37a2329e84a428a42c492e867f6a8/users/daeb26b81ac5429e955339da03eb5a51/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:37.241844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df309ea-bce4-43fc-ae01-2cbbe8f8f9b2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.250768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.251268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.251547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.295733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] MFA Rules not processed for user `daeb26b81ac5429e955339da03eb5a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:37.297614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:37.416123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.417015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.417448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.417876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.419424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.424267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.455011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1064/2099] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:37.459470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.476219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9565e5a-6ef6-41c5-ac53-4b90099efa5b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.481917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1036/2100] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:37.490448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.491184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.491406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.491761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.495943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.501840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.526245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.528324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1065/2101] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:37.533586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.535042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:37.552114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe7acc-48c8-4ab2-9154-aafa3e835616 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.563846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.565076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.565552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.565977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] PATH_INFO: `/v3/projects/cc0155b56b86403d823b72ea4b9759be/users/d40532fd0a7c42d2866f56eade9894be/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.589983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0155b56b86403d823b72ea4b9759be, user_id=d40532fd0a7c42d2866f56eade9894be, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.593952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a49a-f49e-4737-ad28-88ecb265c80c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.628869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1066/2102] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:37 2022] PUT /identity/v3/projects/cc0155b56b86403d823b72ea4b9759be/users/d40532fd0a7c42d2866f56eade9894be/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:37.643983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09494-8532-4ca7-9180-431134f7283e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.645212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09494-8532-4ca7-9180-431134f7283e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.645643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09494-8532-4ca7-9180-431134f7283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.649899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eb2ef-5bfc-49c7-9131-31e466755768 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.675495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:37.694958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-74c09494-8532-4ca7-9180-431134f7283e None None] MFA Rules not processed for user `d40532fd0a7c42d2866f56eade9894be`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:37.696392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-74c09494-8532-4ca7-9180-431134f7283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:37.729749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.731161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.731275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.731461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.733487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:37.793163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1067/2103] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:37.816841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:37.829839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.831313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.839142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09494-8532-4ca7-9180-431134f7283e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:37.840552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-74c09494-8532-4ca7-9180-431134f7283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:37.842182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1037/2104] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:37.853221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09494-8532-4ca7-9180-431134f7283e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:37.857364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:37.858551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:37.858818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:37.859098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:37.867575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:37.868990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:37.878579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1068/2105] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:39.393770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:39.407413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93194278-af46-42e9-a49c-479cba07ec7d service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:39.412236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:39.412871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:39.413145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:39.413539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:39.415321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:39.477982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:39.479703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:39.490449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1038/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:40.263894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:40.272816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa69d-0e81-4a1e-86df-38253f711b8c service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:40.276917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:40.277581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:40.277925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:40.278200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:40.436324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:40.442080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d781f-7450-4f04-96f4-78e4285e5ba1 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:40.460877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1069/2107] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:41.230885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:41.232806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:41.302476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450557-ab8c-4382-99cc-0e3190abe40b service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:41.308274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:41.309233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:41.309492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:41.309782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] PATH_INFO: `/v3/users/d093ed0d085246cab379ee5414ebc78d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:41.311836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d093ed0d085246cab379ee5414ebc78d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:41.314111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:41.384321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd093ed0d085246cab379ee5414ebc78d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:41.385268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd093ed0d085246cab379ee5414ebc78d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:41.386064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd093ed0d085246cab379ee5414ebc78d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:41.397668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd093ed0d085246cab379ee5414ebc78d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:41.411519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd093ed0d085246cab379ee5414ebc78d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:41.428589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1039/2108] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:41 2022] DELETE /identity/v3/users/d093ed0d085246cab379ee5414ebc78d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:41.432935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:41.434665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:41.435123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:41.482905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:41.484274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:41.566326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1070/2109] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:41.581251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:41.584136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:41.597543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:41.668191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e649b0-f74f-42f2-be7c-cd931170bcc8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:41.675887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:41.676629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:41.677151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:41.678133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:41.712082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:41.719557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:41.741710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1040/2110] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:42.385447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:42.387692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:42.428090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c218d-bef3-4fc6-a55e-14f447b88c2c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:42.458986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:42.464412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:42.466507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:42.466507 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] PATH_INFO: `/v3/projects/acbf73e56a674e84a3ce16959144099e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:42.467103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbf73e56a674e84a3ce16959144099e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:42.471268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:42.534354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:42.613001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbf73e56a674e84a3ce16959144099e', 'request_id': 'req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.623236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbf73e56a674e84a3ce16959144099e', 'request_id': 'req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.630380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbf73e56a674e84a3ce16959144099e', 'request_id': 'req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.649652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] The token cache is being invalidate because project acbf73e56a674e84a3ce16959144099e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:42.649961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.651942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.656228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1071/2111] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:42 2022] DELETE /identity/v3/projects/acbf73e56a674e84a3ce16959144099e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:42.660409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:42.680203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8e7d7-dd76-40da-b758-90e53c7b00e3 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:42.750080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:42.752024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:42.807311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:42.808280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:42.808636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:42.809073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] PATH_INFO: `/v3/users/cd8d00fffa874e0ab4b8703241bb7795` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:42.810381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8d00fffa874e0ab4b8703241bb7795)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:42.814333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:42.842459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543d54c-2be6-4b7e-8f6e-cfa2924474ce admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:42.849154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:42.849799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:42.850074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:42.850418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] PATH_INFO: `/v3/users/cec2a7fd7a004953a5f9d901c323f39e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:42.851599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec2a7fd7a004953a5f9d901c323f39e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:42.854480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:42.876346 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8d00fffa874e0ab4b8703241bb7795'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.877064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8d00fffa874e0ab4b8703241bb7795'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.877659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8d00fffa874e0ab4b8703241bb7795'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.886525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8d00fffa874e0ab4b8703241bb7795'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.913961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8d00fffa874e0ab4b8703241bb7795'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.920736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec2a7fd7a004953a5f9d901c323f39e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.921674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec2a7fd7a004953a5f9d901c323f39e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.930603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec2a7fd7a004953a5f9d901c323f39e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.931879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1041/2112] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:42 2022] DELETE /identity/v3/users/cd8d00fffa874e0ab4b8703241bb7795 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:42.949522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec2a7fd7a004953a5f9d901c323f39e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.960228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec2a7fd7a004953a5f9d901c323f39e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:42.968094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1072/2113] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:42 2022] DELETE /identity/v3/users/cec2a7fd7a004953a5f9d901c323f39e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:43.192023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.193782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.266558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:43.275565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.277572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.318559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:43.335519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76eee-98ba-4122-b81a-5dc3261636ae admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.370331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa667e-8e13-403d-9fb1-da5dd4717959 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.375960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.376838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.377276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.377655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] PATH_INFO: `/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.379267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0abcefe88bd4bb8b063f820d3b50e20)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.381169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.451046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.451734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.452208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.452828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] PATH_INFO: `/v3/projects/c34348399d1747e48a10c9428a36b812` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.454570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34348399d1747e48a10c9428a36b812)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.459095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.476082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0abcefe88bd4bb8b063f820d3b50e20', 'request_id': 'req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.488793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0abcefe88bd4bb8b063f820d3b50e20', 'request_id': 'req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.495143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0abcefe88bd4bb8b063f820d3b50e20', 'request_id': 'req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.511136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] The token cache is being invalidate because project a0abcefe88bd4bb8b063f820d3b50e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:43.511629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.512458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b6a0b3fb-b7b7-4a7e-9c3d-f533e46971ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.515141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1073/2114] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:43 2022] DELETE /identity/v3/projects/a0abcefe88bd4bb8b063f820d3b50e20 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:43.519559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1bea-0550-4a60-9f85-50e5e7f0b82c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.519846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1bea-0550-4a60-9f85-50e5e7f0b82c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.520456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe1bea-0550-4a60-9f85-50e5e7f0b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.537438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34348399d1747e48a10c9428a36b812', 'request_id': 'req-15863fdf-8647-48fd-ba54-ee5972474d58'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.544106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34348399d1747e48a10c9428a36b812', 'request_id': 'req-15863fdf-8647-48fd-ba54-ee5972474d58'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.551444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34348399d1747e48a10c9428a36b812', 'request_id': 'req-15863fdf-8647-48fd-ba54-ee5972474d58'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.561897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-58fe1bea-0550-4a60-9f85-50e5e7f0b82c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:43.563957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-58fe1bea-0550-4a60-9f85-50e5e7f0b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.569793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] The token cache is being invalidate because project c34348399d1747e48a10c9428a36b812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:43.570332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.570988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-15863fdf-8647-48fd-ba54-ee5972474d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:43.576081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1042/2115] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:43 2022] DELETE /identity/v3/projects/c34348399d1747e48a10c9428a36b812 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:43.586089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98a6e-de23-4f39-843e-790641f3b628 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.586089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98a6e-de23-4f39-843e-790641f3b628 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.586089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a98a6e-de23-4f39-843e-790641f3b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.613401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-84a98a6e-de23-4f39-843e-790641f3b628 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:43.614802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-84a98a6e-de23-4f39-843e-790641f3b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.669515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1074/2116] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:43.671995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.672485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.672605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.697509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:43.698869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.701349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1043/2117] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:43.704065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.704065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.704302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.712404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1075/2118] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:43.713927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.725192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362c0da-b7cc-47e0-9f60-2466d2c3741e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.732902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.733598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.733946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.734316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.735033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:43.735399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.737040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.737400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:43.739695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:43.749615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1044/2119] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:43.751112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1076/2120] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:43.755530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.756392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.778951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:43.783654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afd57a-8d78-419e-a4ba-55e6cfcd1e37 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.788004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfd64-31c0-4b0f-8068-0608e097b2e2 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.793733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.795093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.795791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.796070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.796192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.796855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.797394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.797738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.798428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:43.798548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.799018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.800551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.800654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.816499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1077/2121] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:25:43.826294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.843937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0957-dcce-4d95-abb4-dc8750d00f4a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.844528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1045/2122] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:43.848704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.863232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:43.930525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.931150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.931430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.931702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.932342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.934951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.946638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730495a-811d-44e0-aa18-c4ce3cf608a6 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:43.956407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:43.957373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:43.957729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:43.958001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:43.958713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:43.961046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:43.984472 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1078/2123] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:43.988733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:43.993653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1046/2124] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:43.999422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.016735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06537b01-feec-42be-b058-0153d753fc9e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.088045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8092a-8b1a-467d-85a6-58a82f2b6e8a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.093901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.094543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.094819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.095092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.095729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.098525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.100220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.101194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.101624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.102043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.102870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.105423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.130564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1079/2125] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:43 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:44.134375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.136028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1047/2126] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:44.136926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.148309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03e42-fb5a-40b0-95fe-442b891735a1 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.154119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.154871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.155237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.155524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.155912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046bb0-d607-4a03-b70c-cda1be49212d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.157079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.158743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.160835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.161476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.161757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.162028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.162715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.164301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.174395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1048/2127] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:44.175324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.176144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1080/2128] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:44.176968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.179942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:44.189377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae856abf-ccf4-45bf-89e6-512b9c6b9c3a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.194466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.195199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.195549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.196006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] PATH_INFO: `/v3/projects/5c7d9f9c7f8c4a739d4e2bf60e495261/users/ffb81e64a8a74267964ab5411037367f/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.212279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7d9f9c7f8c4a739d4e2bf60e495261, user_id=ffb81e64a8a74267964ab5411037367f, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.215419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.239203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1081/2129] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:44 2022] PUT /identity/v3/projects/5c7d9f9c7f8c4a739d4e2bf60e495261/users/ffb81e64a8a74267964ab5411037367f/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:44.243261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.265567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb76e09-5c04-46dc-9a29-2478d790dae5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.277859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:44.331941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8990f5-8372-4dea-9082-2521a9eeb52c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.339319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.340007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.340578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.340790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.340913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.341154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.342902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.343504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.344377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:44.344500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.346238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12be5c-3872-4354-a760-3c7a270401e0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.348440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:44.364301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1082/2130] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:44.367206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.367206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.367206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.409222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] MFA Rules not processed for user `ffb81e64a8a74267964ab5411037367f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:44.411167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:44.417959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.419027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.434412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1049/2131] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:44.436112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.468076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e7a-507f-43dc-92dc-8f210734807a service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.475633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.476319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.476603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.476859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] PATH_INFO: `/v3/projects/1aa4ee2b38304cbaa21a1b93ee4e3f5e/users/6a7e5dcbc3094702935241be3a9c811f/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.500017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa4ee2b38304cbaa21a1b93ee4e3f5e, user_id=6a7e5dcbc3094702935241be3a9c811f, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.505027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8d0e0-2b4e-4d45-b01e-9a7fe31e8c73 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.525766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1050/2132] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:44 2022] PUT /identity/v3/projects/1aa4ee2b38304cbaa21a1b93ee4e3f5e/users/6a7e5dcbc3094702935241be3a9c811f/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:44.532144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.532797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.533289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.535945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1083/2133] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:44.540613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.552761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7576a-c556-4afe-82ac-89df54540b4f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.565949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:44.567858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:44.660434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.661116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.661400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.661810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.662393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.664298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.675780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1051/2134] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:44.686062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.688148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:44.694586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1084/2135] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:44.698165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.747994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:44.768037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8844d33-dc4c-4e53-8852-3e917037108a None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.774404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998d97-9d9a-4fe0-a7b7-866d1028d12a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.779363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.780721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.781183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.781528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.782403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.784561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.803365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:44.815153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1085/2136] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:44 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:25:44.820384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.831585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.833080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.833475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.836183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.837028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64b188-413b-4770-8351-06d9a511aae3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.843420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.844453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.844732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.845061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.846407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.848229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.848743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.851303 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.860860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1086/2137] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:44.862990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1052/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:44.865323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.875493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd23a30-2a25-4542-8826-80d3cc1fda58 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:44.880489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:44.881201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:44.881480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:44.881773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] PATH_INFO: `/v3/projects/33980231092b4efcbe12a00c8b94fa40/users/4e94f7bf952542f3928dca26dd83fe27/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:44.899222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33980231092b4efcbe12a00c8b94fa40, user_id=4e94f7bf952542f3928dca26dd83fe27, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:44.907092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:44.929390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1087/2139] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:44 2022] PUT /identity/v3/projects/33980231092b4efcbe12a00c8b94fa40/users/4e94f7bf952542f3928dca26dd83fe27/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:44.933178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:44.944252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3408e-7a1b-4302-89d9-28474b2151be service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.034119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.034846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.035139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.036067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.037089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.039511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53a41d-9ad1-4554-85cd-fb89458b5536 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.056437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1053/2140] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:45.063616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.076342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c4bb-166f-41a2-b806-60c22a0d2774 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.088848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.089761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.093776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.094132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] PATH_INFO: `/v3/projects/33980231092b4efcbe12a00c8b94fa40/users/4e94f7bf952542f3928dca26dd83fe27/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.097852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33980231092b4efcbe12a00c8b94fa40, user_id=4e94f7bf952542f3928dca26dd83fe27, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.101040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.120695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1088/2141] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:45 2022] PUT /identity/v3/projects/33980231092b4efcbe12a00c8b94fa40/users/4e94f7bf952542f3928dca26dd83fe27/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:45.133119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.133421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.133720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.183937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] MFA Rules not processed for user `4e94f7bf952542f3928dca26dd83fe27`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:45.185373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.277314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1054/2142] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:45.314151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.316068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.318512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.344494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:45.418150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7748c-2d78-42fd-b0f2-291a25c1ac36 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.437678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.438899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.439385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.439667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.454056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4d07-a6fe-4652-b73c-e407bb1ea15a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.463542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.465073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.466747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.467687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.468356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.468595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] PATH_INFO: `/v3/users/62023485417f48948ff4bbe5be3fc2d7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.471047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62023485417f48948ff4bbe5be3fc2d7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.473042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.489864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1055/2143] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:45.561666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62023485417f48948ff4bbe5be3fc2d7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.564502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62023485417f48948ff4bbe5be3fc2d7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.587349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62023485417f48948ff4bbe5be3fc2d7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.606256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.619777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62023485417f48948ff4bbe5be3fc2d7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.621297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013639b-3cfd-46de-910e-c5e3d6841a14 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.628095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.628879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.629289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.629676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] PATH_INFO: `/v3/users/ffb81e64a8a74267964ab5411037367f` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.631123 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb81e64a8a74267964ab5411037367f)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.633537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-449bece4-18a0-4b2b-8992-d368377239b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62023485417f48948ff4bbe5be3fc2d7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.634093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.647962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1089/2144] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:45 2022] DELETE /identity/v3/users/62023485417f48948ff4bbe5be3fc2d7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:45.650080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdad4-450a-4a76-9c3d-b23ce13ff31e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.650579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdad4-450a-4a76-9c3d-b23ce13ff31e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.651786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fdad4-450a-4a76-9c3d-b23ce13ff31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.677275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-770fdad4-450a-4a76-9c3d-b23ce13ff31e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:45.679084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-770fdad4-450a-4a76-9c3d-b23ce13ff31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.712282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:45.735438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb81e64a8a74267964ab5411037367f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.736771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb81e64a8a74267964ab5411037367f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.737480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb81e64a8a74267964ab5411037367f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.754804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb81e64a8a74267964ab5411037367f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.775897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb81e64a8a74267964ab5411037367f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:45.796730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1090/2145] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:45.799381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1056/2146] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:45 2022] DELETE /identity/v3/users/ffb81e64a8a74267964ab5411037367f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:45.821581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.821794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.822049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.822452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.826388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.850063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:45.851471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.926702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1091/2147] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:45.933445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000727a-639e-4124-9b80-56a3c32aacd7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.938421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.939116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.939492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.939778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.947140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:45.949995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:45.964834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.970271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:45.970578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c73d-cd22-4625-bcdf-b5c068ff7175 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:45.975242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:45.975873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:45.976150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:45.976417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:45.985275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1057/2148] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:45.987767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:45.989216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f13c6d-c4fb-43fb-9ba8-1720c651f0b4 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:46.002588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1092/2149] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:25:46.125396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.130137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.157838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15027d1-990b-4f94-8cbd-88dcef752302 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:46.168004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:46.184072 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:46.184290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:46.184482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] PATH_INFO: `/v3/users/d40532fd0a7c42d2866f56eade9894be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:46.185834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40532fd0a7c42d2866f56eade9894be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:46.189848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:46.267957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:46.290456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40532fd0a7c42d2866f56eade9894be'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.291147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40532fd0a7c42d2866f56eade9894be'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.291771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40532fd0a7c42d2866f56eade9894be'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.316005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40532fd0a7c42d2866f56eade9894be'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.338132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40532fd0a7c42d2866f56eade9894be'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.360547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1058/2150] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:46 2022] DELETE /identity/v3/users/d40532fd0a7c42d2866f56eade9894be => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:46.365068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:46.365357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:46.365635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:46.387109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:46.388638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.475537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1093/2151] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:46.486500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.489757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.571872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a791-b039-491a-81c7-34b8641d985d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:46.577449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:46.578431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:46.578825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:46.579326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:46.591107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:46.593172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:46.604808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1059/2152] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:46.675993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.677562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.698356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447f55-db85-4a6b-8d32-1abe96543907 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:46.704324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:46.704985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:46.705266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:46.705544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] PATH_INFO: `/v3/projects/46a1b8bdaa034580b21a2a68db49f622` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:46.706796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a1b8bdaa034580b21a2a68db49f622)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:46.709625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:46.729566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.731459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.753784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302b1ae-c722-48cb-a029-ac83db65086c service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:46.768019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:46.768838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:46.769224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:46.769729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] PATH_INFO: `/v3/projects/5c7d9f9c7f8c4a739d4e2bf60e495261` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:46.771370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7d9f9c7f8c4a739d4e2bf60e495261)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:46.774896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:46.808618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a1b8bdaa034580b21a2a68db49f622', 'request_id': 'req-ee877faf-e5f9-441c-8f48-044c64750ea7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.819650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a1b8bdaa034580b21a2a68db49f622', 'request_id': 'req-ee877faf-e5f9-441c-8f48-044c64750ea7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.823219 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:46.833156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a1b8bdaa034580b21a2a68db49f622', 'request_id': 'req-ee877faf-e5f9-441c-8f48-044c64750ea7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.855433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] The token cache is being invalidate because project 46a1b8bdaa034580b21a2a68db49f622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:46.855902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.856596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.859135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1094/2153] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:46 2022] DELETE /identity/v3/projects/46a1b8bdaa034580b21a2a68db49f622 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:46.864286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.867607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:46.903951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7d9f9c7f8c4a739d4e2bf60e495261', 'request_id': 'req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.922711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7d9f9c7f8c4a739d4e2bf60e495261', 'request_id': 'req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.939156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7d9f9c7f8c4a739d4e2bf60e495261', 'request_id': 'req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.968878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] The token cache is being invalidate because project 5c7d9f9c7f8c4a739d4e2bf60e495261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:46.969263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.970600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:46.976015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1060/2154] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:46 2022] DELETE /identity/v3/projects/5c7d9f9c7f8c4a739d4e2bf60e495261 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:46.978383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:46.981226 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:47.027928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:47.040479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877faf-e5f9-441c-8f48-044c64750ea7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:47.087611 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ef0a5-f4ac-442e-af14-54dd89f1aed9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:47.107476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:47.108716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:47.108995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:47.109318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] PATH_INFO: `/v3/users/4e94f7bf952542f3928dca26dd83fe27` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:47.111863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e94f7bf952542f3928dca26dd83fe27)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:47.114120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:47.221863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e94f7bf952542f3928dca26dd83fe27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.223956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e94f7bf952542f3928dca26dd83fe27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.226045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e94f7bf952542f3928dca26dd83fe27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.285207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:47.286065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e94f7bf952542f3928dca26dd83fe27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.288324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:47.288324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:47.289289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] PATH_INFO: `/v3/users/0d9c7b430b7140f1aff36c4290e090a8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:47.291447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9c7b430b7140f1aff36c4290e090a8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:47.298065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:47.344804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e94f7bf952542f3928dca26dd83fe27'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.373070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1061/2155] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:46 2022] DELETE /identity/v3/users/4e94f7bf952542f3928dca26dd83fe27 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:47.373070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:47.375326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:47.455372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9c7b430b7140f1aff36c4290e090a8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.456217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9c7b430b7140f1aff36c4290e090a8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.468234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9c7b430b7140f1aff36c4290e090a8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.486784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9c7b430b7140f1aff36c4290e090a8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.501865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9c7b430b7140f1aff36c4290e090a8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.509919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1095/2156] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:46 2022] DELETE /identity/v3/users/0d9c7b430b7140f1aff36c4290e090a8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:47.513256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcbe38-727e-4dbe-aeae-e7ed6f46df0d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:47.583539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:47.584293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:47.584929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:47.585225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] PATH_INFO: `/v3/projects/cc0155b56b86403d823b72ea4b9759be` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:47.586668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0155b56b86403d823b72ea4b9759be)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:47.589538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:47.595769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:47.676338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0155b56b86403d823b72ea4b9759be', 'request_id': 'req-39b744fd-a5bb-46c0-88f6-046cd0f24253'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.686562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0155b56b86403d823b72ea4b9759be', 'request_id': 'req-39b744fd-a5bb-46c0-88f6-046cd0f24253'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.693512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0155b56b86403d823b72ea4b9759be', 'request_id': 'req-39b744fd-a5bb-46c0-88f6-046cd0f24253'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.720858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] The token cache is being invalidate because project cc0155b56b86403d823b72ea4b9759be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:47.721208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.722004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:47.724826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1062/2157] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:47 2022] DELETE /identity/v3/projects/cc0155b56b86403d823b72ea4b9759be => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:47.972659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:47.974190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:47.979136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:47.983169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:47.989969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5690b-824a-4d36-9d1f-56485e132a7c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:48.000794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:48.096237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:48.096991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.097275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.097599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] PATH_INFO: `/v3/projects/172a62c737754751a9459f769c433de2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.113940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172a62c737754751a9459f769c433de2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:48.123030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:48.147556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b744fd-a5bb-46c0-88f6-046cd0f24253 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:48.153476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:48.154130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.155274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.155738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] PATH_INFO: `/v3/projects/33980231092b4efcbe12a00c8b94fa40` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.156986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33980231092b4efcbe12a00c8b94fa40)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:48.159366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:48.233632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33980231092b4efcbe12a00c8b94fa40', 'request_id': 'req-66b5b812-2549-411a-822b-8f65bc78bf4b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.242112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33980231092b4efcbe12a00c8b94fa40', 'request_id': 'req-66b5b812-2549-411a-822b-8f65bc78bf4b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.249336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33980231092b4efcbe12a00c8b94fa40', 'request_id': 'req-66b5b812-2549-411a-822b-8f65bc78bf4b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.274789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] The token cache is being invalidate because project 33980231092b4efcbe12a00c8b94fa40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:48.275199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.275999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-66b5b812-2549-411a-822b-8f65bc78bf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.276505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172a62c737754751a9459f769c433de2', 'request_id': 'req-709581ba-88d9-4708-9cab-7778e04bc291'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.278282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1063/2158] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:47 2022] DELETE /identity/v3/projects/33980231092b4efcbe12a00c8b94fa40 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:48.283139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b58e-5e74-40ae-8251-8ba9f7afeb5f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.283546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b58e-5e74-40ae-8251-8ba9f7afeb5f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.284045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b58e-5e74-40ae-8251-8ba9f7afeb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.294286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172a62c737754751a9459f769c433de2', 'request_id': 'req-709581ba-88d9-4708-9cab-7778e04bc291'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.311849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172a62c737754751a9459f769c433de2', 'request_id': 'req-709581ba-88d9-4708-9cab-7778e04bc291'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.330007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ebb6b58e-5e74-40ae-8251-8ba9f7afeb5f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:48.336566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ebb6b58e-5e74-40ae-8251-8ba9f7afeb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:48.338184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] The token cache is being invalidate because project 172a62c737754751a9459f769c433de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:48.344423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.346037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.347642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1096/2159] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:47 2022] DELETE /identity/v3/projects/172a62c737754751a9459f769c433de2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:48.358718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:48.362587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:48.399431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:48.514877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1064/2160] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:48.518077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709581ba-88d9-4708-9cab-7778e04bc291 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:48.525433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.525765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.526043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.543279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:48.544095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.544479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.546544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] PATH_INFO: `/v3/users/daeb26b81ac5429e955339da03eb5a51` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.548484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daeb26b81ac5429e955339da03eb5a51)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:48.554154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:48.555936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:48.557571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:48.583946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1065/2161] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:48.610088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:48.632719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63994b-91a2-407f-8684-aee63e1b7dde None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:48.642983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:48.650159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:48.651084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.651366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.651890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.652856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:48.653170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:48.655097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:48.662481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daeb26b81ac5429e955339da03eb5a51'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.665729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daeb26b81ac5429e955339da03eb5a51'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.671767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1066/2162] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:48.676746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:48.682962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daeb26b81ac5429e955339da03eb5a51'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.708831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24fae-096c-4db7-a7a5-ed88392b768f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:48.711721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daeb26b81ac5429e955339da03eb5a51'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.714529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:48.715153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:48.715435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:48.715710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:48.716354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:48.719178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:48.725424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daeb26b81ac5429e955339da03eb5a51'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:48.740272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1097/2163] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:48 2022] DELETE /identity/v3/users/daeb26b81ac5429e955339da03eb5a51 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:48.799867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1067/2164] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:48 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:48.803221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:48.804667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:48.979839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9baa1a-6df9-412b-a666-e4ee4a93eee0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.112002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.112819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.113202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.114810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.115587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.118461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.162879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1098/2165] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:48 2022] POST /identity/v3/users => generated 294 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:49.164538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.176406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc8fc9-c97d-44be-8e76-316a3bb5ab17 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.182440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.183278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.183748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.184167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.184962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.187408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.201071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1068/2166] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:49.205805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.219352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50a7d-aab6-4979-8dcd-ea5c02714287 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.228313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.230087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.230542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.230959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.231866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.235541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01a42-1aab-46c3-a1e5-b33f26f84b90 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.252222 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.253453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1099/2167] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:49.268186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd4f-560f-4945-acc8-aa858961eb59 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.275223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.276141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.276536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.277179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] PATH_INFO: `/v3/projects/f7be125ae8bb42aa9318f3a73c69a5d8/users/3b54ef9ebd494ba382a6fea4bf973be8/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.300726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7be125ae8bb42aa9318f3a73c69a5d8, user_id=3b54ef9ebd494ba382a6fea4bf973be8, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.304131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.326483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1069/2168] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:49 2022] PUT /identity/v3/projects/f7be125ae8bb42aa9318f3a73c69a5d8/users/3b54ef9ebd494ba382a6fea4bf973be8/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:49.335465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.335769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.336004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.370667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.373021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.408308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] MFA Rules not processed for user `3b54ef9ebd494ba382a6fea4bf973be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:49.409719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.451417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:49.501586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e115758-697d-4a8e-a544-55f096beb1d8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.502394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1100/2169] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:49.503588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.505716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.511382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.512507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.512995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.513658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] PATH_INFO: `/v3/projects/08f37a2329e84a428a42c492e867f6a8` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.515935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f37a2329e84a428a42c492e867f6a8)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.518578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.523198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea58668-7a25-4ed3-98fb-3fdf12dec793 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.528144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.528843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.529288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.529568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] PATH_INFO: `/v3/users/d4ca6dd971cd461c8fc79178cd726ce7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.532849 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ca6dd971cd461c8fc79178cd726ce7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.536110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.584166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:49.593122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f37a2329e84a428a42c492e867f6a8', 'request_id': 'req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.599654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ca6dd971cd461c8fc79178cd726ce7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.600347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ca6dd971cd461c8fc79178cd726ce7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.602767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f37a2329e84a428a42c492e867f6a8', 'request_id': 'req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.611690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f37a2329e84a428a42c492e867f6a8', 'request_id': 'req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.614782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ca6dd971cd461c8fc79178cd726ce7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.632244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ca6dd971cd461c8fc79178cd726ce7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.635380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] The token cache is being invalidate because project 08f37a2329e84a428a42c492e867f6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:49.636744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.636744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.641930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1070/2170] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:49 2022] DELETE /identity/v3/projects/08f37a2329e84a428a42c492e867f6a8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:49.641930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:49.641930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.647465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8fafe078-eada-4f55-bf17-ab9704237210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ca6dd971cd461c8fc79178cd726ce7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:49.658637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1101/2171] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:25:49 2022] DELETE /identity/v3/users/d4ca6dd971cd461c8fc79178cd726ce7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:49.660859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f5dc7-8253-4741-b2ba-c689de22a5fd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.661377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f5dc7-8253-4741-b2ba-c689de22a5fd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.662119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f5dc7-8253-4741-b2ba-c689de22a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.693619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff0f5dc7-8253-4741-b2ba-c689de22a5fd None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:49.694673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff0f5dc7-8253-4741-b2ba-c689de22a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.728365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bb7f0-6ec5-4b32-9394-259bb6fa01dd admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:49.823994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:49.824953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.825325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.825814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.827853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:49.830670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a9b59-f69b-4865-8aa2-51b92c0924da admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:49.846079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1102/2172] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:49.848692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.849040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.849406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.894315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1071/2173] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:49.896682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:49.897467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:49.897971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:49.903590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:49.910524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:49.930564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:49.932245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.023957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:50.042367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1072/2174] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:50.043236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.044856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.052255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1103/2175] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:50.053195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.061012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae389d3-e595-466e-852d-52cca8e64340 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.067602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.068608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.068993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.069562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.070252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.071227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50b84b-5437-4818-a242-10fb8bc5b9d2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.072899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.076368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.077141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.077447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.077722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.078410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:50.078722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.080550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.082562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:50.098474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1104/2176] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:50.103005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.104948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.111808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1073/2177] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:50.113142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.127418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188c4d-f2d5-485c-b353-9bdaeacf1ad3 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.134623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.135438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.136269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.136671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.137771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.140067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.186857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1074/2178] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:50.187798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.210730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd574-2834-4700-b37b-a58c512be49b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.272071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.273234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.273676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.274096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.360516 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb3671-5554-4136-a503-3acad059c60d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.371794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.372487 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.372783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.373040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.374582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.379893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.404150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.406512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.407268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1075/2179] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:50.408113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.423976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1105/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:50.424560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.438571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8db598-b003-4967-a41c-702363c2fadf service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.443732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58492bda-f144-4afe-84dc-a017747ff10b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.445934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.446959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.447515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.447984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.448820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.449029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.449427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.449707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.450138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.450882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.454002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.454239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.474495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1106/2181] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:50.475634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.492183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1076/2182] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/users => generated 285 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:50.496174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b426a-400b-4a79-b9f6-637aeac980ed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.498157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.513263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.513944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.516846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.516846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] PATH_INFO: `/v3/projects/859bdb10549d4ac78edc73e023aced11/users/a241cb81dcb9466a96d9447bc6699b4f/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.521281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe47810-2ffc-4148-947d-ebe573bd2fba admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.527143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.528709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.528962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.529234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.530590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.532186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.546327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1077/2183] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:50.550733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.562399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=859bdb10549d4ac78edc73e023aced11, user_id=a241cb81dcb9466a96d9447bc6699b4f, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.565088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.566890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387287d-3f0d-4705-9860-04170d9691aa admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.574407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.575302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.575962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.576424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.578421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.580665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b0078-e4c4-4977-95e2-217d3fad667a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.592872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1107/2184] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:50 2022] PUT /identity/v3/projects/859bdb10549d4ac78edc73e023aced11/users/a241cb81dcb9466a96d9447bc6699b4f/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:25:50.596638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1078/2185] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:25:50.601360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.604610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945429-8d80-4d57-8215-055843467573 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.605169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945429-8d80-4d57-8215-055843467573 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.605448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945429-8d80-4d57-8215-055843467573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.626559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:50.645687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-db945429-8d80-4d57-8215-055843467573 None None] MFA Rules not processed for user `a241cb81dcb9466a96d9447bc6699b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:50.647586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-db945429-8d80-4d57-8215-055843467573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.750125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1079/2186] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:25:50.754371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db945429-8d80-4d57-8215-055843467573 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.758138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe442389-a5ea-44e8-8cbc-ba06d1798ccc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.763780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.765969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.766958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.767418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] PATH_INFO: `/v3/projects/eb7f578a873e405e96151ba207547a4e/users/30e4084ddef74c7cb2aa913b267d8a13/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.783666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db945429-8d80-4d57-8215-055843467573 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.795366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7f578a873e405e96151ba207547a4e, user_id=30e4084ddef74c7cb2aa913b267d8a13, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.797435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.798256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.801864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.802159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.802578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.803254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:50.805179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7079fb1-2db8-4224-b610-8ed54e07019d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:50.829243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1108/2187] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:50 2022] PUT /identity/v3/projects/eb7f578a873e405e96151ba207547a4e/users/30e4084ddef74c7cb2aa913b267d8a13/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:50.829455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:50.829538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.830826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.853782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1080/2188] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:50.855810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.856283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.857870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:50.895615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] MFA Rules not processed for user `30e4084ddef74c7cb2aa913b267d8a13`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:50.897451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:50.915372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f6c66-46b1-4519-9137-cd999863d0af admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:50.996678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1081/2189] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:50.997681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:50.997793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:50.998396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:50.999323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:50.999605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] PATH_INFO: `/v3/projects/916a821948114782b4535c92db12c39e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.000906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916a821948114782b4535c92db12c39e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.009952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.015566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87383a41-e844-4518-bc18-7bfa65fcc4b3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.026350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.028439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.031268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.031569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.032856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.037796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.088974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:51.091399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1082/2190] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:50 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:51.093584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.096661 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.109850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916a821948114782b4535c92db12c39e', 'request_id': 'req-7f799b6a-34a8-4ff1-950a-b7935f69caf0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:51.124043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916a821948114782b4535c92db12c39e', 'request_id': 'req-7f799b6a-34a8-4ff1-950a-b7935f69caf0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:51.142717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916a821948114782b4535c92db12c39e', 'request_id': 'req-7f799b6a-34a8-4ff1-950a-b7935f69caf0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:51.167837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] The token cache is being invalidate because project 916a821948114782b4535c92db12c39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:25:51.168130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:51.169778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:25:51.175711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1109/2191] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:25:50 2022] DELETE /identity/v3/projects/916a821948114782b4535c92db12c39e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:51.175711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.178336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.237755 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d475-cfae-481b-b09d-972cfe09d847 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.305379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799b6a-34a8-4ff1-950a-b7935f69caf0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.310676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.311952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.313032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.313322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.314121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.315857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c081ec-54ef-43dc-b9ab-5daaadc4d0b1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.337720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1110/2192] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:51.339211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.339499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.339920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.382586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:51.384027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.385958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.386634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.392255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.393896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.395546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1111/2193] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:51.403665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.405620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.423535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812771fd-ca1c-47ea-a567-f669ae45e86c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.437414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.438114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.438419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.455943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] PATH_INFO: `/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa/users/142810af686e416a837093823ab599aa/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.482468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:51.485782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ab84aa2ae540d18e3408c96e42e5fa, user_id=142810af686e416a837093823ab599aa, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.490872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcbb93-3411-4bb2-9fe1-7ff224fe5ce6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.521820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1112/2194] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:51 2022] PUT /identity/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa/users/142810af686e416a837093823ab599aa/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:51.523377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcdd3-cbb4-42a0-8732-93561bf1077b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.523770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcdd3-cbb4-42a0-8732-93561bf1077b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.524151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdcdd3-cbb4-42a0-8732-93561bf1077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.543995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.546421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.550505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b7bdcdd3-cbb4-42a0-8732-93561bf1077b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:51.552278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b7bdcdd3-cbb4-42a0-8732-93561bf1077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.571188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1083/2195] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:51.572050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.597962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501688-7f2e-4a1b-af9c-15e1562ac9b5 service glance] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.706342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1113/2196] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:51.709683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f849-9e92-41e3-9ce7-df97b6297ce8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.709683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f849-9e92-41e3-9ce7-df97b6297ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.709683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559f849-9e92-41e3-9ce7-df97b6297ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.726681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.727321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.727607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.727881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.731109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.732769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.752079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e559f849-9e92-41e3-9ce7-df97b6297ce8 None None] MFA Rules not processed for user `6a7e5dcbc3094702935241be3a9c811f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:51.753326 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e559f849-9e92-41e3-9ce7-df97b6297ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.753468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1084/2197] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:51.754363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.771326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50096-410d-4fe7-9beb-d84bc36d511e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.779210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.780402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.780607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.780897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.781669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:25:51.782007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.783790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.794376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:51.798174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1085/2198] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:25:51.798174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.810932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bdf8c-62dd-4eb0-abb7-93034664d15d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.821846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.822458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.822741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.823174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] PATH_INFO: `/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa/users/142810af686e416a837093823ab599aa/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.825158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ab84aa2ae540d18e3408c96e42e5fa, user_id=142810af686e416a837093823ab599aa, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.829386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.843625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1086/2199] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:51 2022] PUT /identity/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa/users/142810af686e416a837093823ab599aa/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:51.851530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:51.882240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1114/2200] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:51.894182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.894501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.894780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.929174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] MFA Rules not processed for user `142810af686e416a837093823ab599aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:51.930446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:51.938310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5518aa9-2770-4a54-9fe1-2f74c4f5a06a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:51.944074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:51.944074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.944366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.944620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:51.945215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:51.947455 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddb9d4-057e-4b0c-b854-3ffe553ffbfa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:51.990778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1087/2201] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:51.991946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:51.992234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:51.992504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.016715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] MFA Rules not processed for user `6a7e5dcbc3094702935241be3a9c811f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:52.018138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:52.036444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1115/2202] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:52.037662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.051764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875bcd0-78d4-41af-9be8-fc0cb1508e9f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.056264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:52.105980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1088/2203] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:52.107043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.109211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:52.146156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.146981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.147407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.147889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.148631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.151155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.178999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1116/2204] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:25:52 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:25:52.180104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.182929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:52.221446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8bae3-353f-4fb7-bf22-6db3fc04548b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.228605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.229367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.229650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.229923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.253539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:52.336182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da96a3-a42b-49ca-bc4e-c5da4d07e612 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.358905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.359953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.360694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.361169 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.386415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.388042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.393517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.395654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.412815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1089/2205] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:52.413716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.427325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ab3c5-a617-402d-a3fd-4c9ab6f43a9e service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.430363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1117/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:52.435058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.435753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.436108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.436456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.437181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.439098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.452514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1090/2207] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:52.456519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.484321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63508583-09b7-4fb7-bddc-3b31d66bf35d service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.500304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.500930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.501321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.501539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.502143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.503819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963a61-a39a-4b4d-9e73-60df8a426ece admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.520726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1118/2208] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:25:52.521569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.536941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc17f3-507c-405a-920d-957ff7c327ac admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.544630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.545691 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.546293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.548053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] PATH_INFO: `/v3/projects/1db6f9dd59e849ccaa59c7896b476073/users/340b906fc22b4ad38e1fddc26f7750df/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.573682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db6f9dd59e849ccaa59c7896b476073, user_id=340b906fc22b4ad38e1fddc26f7750df, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.578881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:52.604149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.604352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.604621 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.609662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1091/2209] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:25:52 2022] PUT /identity/v3/projects/1db6f9dd59e849ccaa59c7896b476073/users/340b906fc22b4ad38e1fddc26f7750df/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:25:52.637668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:52.642278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:52.801315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1119/2210] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:52.812092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:52.822282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:52.925968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:52.927734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a1fd3-e404-4f38-8f80-7061eba5ce4c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:52.948154 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:52.948792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:52.949118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:52.949381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:52.975920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:52.977616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea6c65-44ee-4b9a-8e48-f90bddacd184 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:53.003665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1092/2211] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:53.348670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:53.350807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:53.466281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d74f-9e04-461d-973a-418e6b62ba7c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:53.470381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:53.471832 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:53.472295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:53.472665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:53.474845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:53.540863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:53.541331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:53.541693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:53.569356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:53.570987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:53.593025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] MFA Rules not processed for user `6a7e5dcbc3094702935241be3a9c811f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:25:53.595172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1120/2212] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:25:53.595473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:53.680593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1093/2213] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:25:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:25:58.195186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:25:58.200580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:25:58.204845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cd56b-8a86-42e8-945c-1fae48be6093 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:25:58.208972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:25:58.209667 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:25:58.210032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:25:58.210392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:25:58.212354 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:25:58.285487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:25:58.287182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5bf51-4bfe-4668-b68e-da26bf568344 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:25:58.298334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1121/2214] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:01.369489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:01.382291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef823a-bfb7-43fe-a225-38cd0aab5f85 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:01.386924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:01.387565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:01.388251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:01.388540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] PATH_INFO: `/v3/users/3b54ef9ebd494ba382a6fea4bf973be8` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:01.390261 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b54ef9ebd494ba382a6fea4bf973be8)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:01.392225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:01.454201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b54ef9ebd494ba382a6fea4bf973be8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:01.455224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b54ef9ebd494ba382a6fea4bf973be8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:01.455897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b54ef9ebd494ba382a6fea4bf973be8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:01.480204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b54ef9ebd494ba382a6fea4bf973be8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:01.502605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b54ef9ebd494ba382a6fea4bf973be8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:01.540461 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1094/2215] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:01 2022] DELETE /identity/v3/users/3b54ef9ebd494ba382a6fea4bf973be8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:01.543973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa35-9dbd-4f1f-b051-4333331c38cf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:01.544805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa35-9dbd-4f1f-b051-4333331c38cf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:01.545306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4fa35-9dbd-4f1f-b051-4333331c38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:01.568217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-38d4fa35-9dbd-4f1f-b051-4333331c38cf None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:01.569531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38d4fa35-9dbd-4f1f-b051-4333331c38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:01.676651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1122/2216] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:01.686902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:01.688438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:01.786633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b64055-5f5b-43b0-8f5e-972f5b49c46c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:01.787111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:01.787402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:01.787787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:01.791186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:01.791808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:01.792090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:01.792364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:01.803182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:01.804549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:01.817636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1095/2217] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:26:01.846945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] MFA Rules not processed for user `340b906fc22b4ad38e1fddc26f7750df`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:01.848526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:01.951055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1123/2218] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:01.957032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:01.958679 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:01.973988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e987a8-f92b-460e-a3af-f0defe20ccca service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:01.988497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:01.989151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:01.989483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:01.991871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:01.992271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:01.994269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.005642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:02.031280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1096/2219] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:01 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:02.037626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.050189 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3ec89-9de1-4e7b-8b1e-b88bc707926a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.093068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:02.138799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.140466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.140815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.141573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.142569 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.144940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.179542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1124/2220] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:02 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:02.182194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.209111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86ab0-9219-4ca6-b3ff-6c69864f1065 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.220121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.220752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.221040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.221319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.221976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.223664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.235346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.237214 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:02.244962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1097/2221] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:26:02.251365 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.259482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66dff6-179d-43f5-8529-d8dc3ffb92ea admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.263995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672b9d7-5e4e-4a66-b64f-492b040724f0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.269866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.270576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.270851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.271125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] PATH_INFO: `/v3/projects/3485448dab16496789e73927f4f667b7/users/f8fb2911923d4117b6358ef0d41b89bd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.275018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.276013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.276751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.277269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] PATH_INFO: `/v3/projects/f7be125ae8bb42aa9318f3a73c69a5d8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.284567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7be125ae8bb42aa9318f3a73c69a5d8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.286610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.304407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485448dab16496789e73927f4f667b7, user_id=f8fb2911923d4117b6358ef0d41b89bd, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.308156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.344754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1098/2222] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:02 2022] PUT /identity/v3/projects/3485448dab16496789e73927f4f667b7/users/f8fb2911923d4117b6358ef0d41b89bd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:02.345995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.400283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7be125ae8bb42aa9318f3a73c69a5d8', 'request_id': 'req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.413584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7be125ae8bb42aa9318f3a73c69a5d8', 'request_id': 'req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.422164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7be125ae8bb42aa9318f3a73c69a5d8', 'request_id': 'req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.430256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96142439-ed3a-4516-a97b-c7af314f8b72 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.455358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] The token cache is being invalidate because project f7be125ae8bb42aa9318f3a73c69a5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:02.455680 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.456992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.461239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1125/2223] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:02 2022] DELETE /identity/v3/projects/f7be125ae8bb42aa9318f3a73c69a5d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:02.465412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.473438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:02.585862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.586631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.586789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.587041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.587665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.589328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.615903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1099/2224] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:02.622205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:02.625714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b7f0f-284e-4cdb-b710-787b4edf60c8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.628900 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:02.636122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.637318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.637788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.638510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] PATH_INFO: `/v3/users/a241cb81dcb9466a96d9447bc6699b4f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.641128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a241cb81dcb9466a96d9447bc6699b4f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.644947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ad89e-09d8-462e-a3f6-f8b7db672116 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:02.645083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.664169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:02.664320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:02.665872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:02.666328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] PATH_INFO: `/v3/projects/3485448dab16496789e73927f4f667b7/users/f8fb2911923d4117b6358ef0d41b89bd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:02.668211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485448dab16496789e73927f4f667b7, user_id=f8fb2911923d4117b6358ef0d41b89bd, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:02.670956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:02.684165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1100/2225] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:02 2022] PUT /identity/v3/projects/3485448dab16496789e73927f4f667b7/users/f8fb2911923d4117b6358ef0d41b89bd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:02.760488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a241cb81dcb9466a96d9447bc6699b4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.761482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a241cb81dcb9466a96d9447bc6699b4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.763557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:02.772848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a241cb81dcb9466a96d9447bc6699b4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.788159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a241cb81dcb9466a96d9447bc6699b4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.796684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a241cb81dcb9466a96d9447bc6699b4f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:02.805097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1126/2226] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:02 2022] DELETE /identity/v3/users/a241cb81dcb9466a96d9447bc6699b4f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:03.135566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:03.137522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:03.222758 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:03.246000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb721fb-f460-4597-82ea-cd6132ccac7a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:03.316636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:03.317231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:03.317520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:03.317785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] PATH_INFO: `/v3/projects/859bdb10549d4ac78edc73e023aced11` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:03.318939 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=859bdb10549d4ac78edc73e023aced11)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:03.321199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:03.379849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859bdb10549d4ac78edc73e023aced11', 'request_id': 'req-98f6df58-d0e9-4c51-8408-00c714fdb6af'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.386800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859bdb10549d4ac78edc73e023aced11', 'request_id': 'req-98f6df58-d0e9-4c51-8408-00c714fdb6af'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.400307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859bdb10549d4ac78edc73e023aced11', 'request_id': 'req-98f6df58-d0e9-4c51-8408-00c714fdb6af'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.418319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] The token cache is being invalidate because project 859bdb10549d4ac78edc73e023aced11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:03.418690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.419410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.422477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1101/2227] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:03 2022] DELETE /identity/v3/projects/859bdb10549d4ac78edc73e023aced11 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:03.426915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:03.437920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6f9c4-663e-4e6a-a414-b36538ccb5c7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:03.548186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:03.549864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:03.550444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:03.551049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] PATH_INFO: `/v3/users/142810af686e416a837093823ab599aa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:03.552457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142810af686e416a837093823ab599aa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:03.555762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:03.657692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142810af686e416a837093823ab599aa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.659662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142810af686e416a837093823ab599aa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.707506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142810af686e416a837093823ab599aa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.758067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142810af686e416a837093823ab599aa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.791213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4b6d5286-ee48-40b9-adaf-76da30c4c281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142810af686e416a837093823ab599aa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:03.807813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1127/2228] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:03 2022] DELETE /identity/v3/users/142810af686e416a837093823ab599aa => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:04.533212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:04.534953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:04.553754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6df58-d0e9-4c51-8408-00c714fdb6af admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:04.646695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:04.647411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:04.647694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:04.648089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] PATH_INFO: `/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:04.649695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ab84aa2ae540d18e3408c96e42e5fa)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:04.651885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:04.682397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:04.719050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ab84aa2ae540d18e3408c96e42e5fa', 'request_id': 'req-30759a87-4734-4df6-9fac-0e8a0ff03dea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:04.732689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ab84aa2ae540d18e3408c96e42e5fa', 'request_id': 'req-30759a87-4734-4df6-9fac-0e8a0ff03dea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:04.755924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ab84aa2ae540d18e3408c96e42e5fa', 'request_id': 'req-30759a87-4734-4df6-9fac-0e8a0ff03dea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:04.776655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] The token cache is being invalidate because project 79ab84aa2ae540d18e3408c96e42e5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:04.777001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:04.777686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-30759a87-4734-4df6-9fac-0e8a0ff03dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:04.781564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1102/2229] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:04 2022] DELETE /identity/v3/projects/79ab84aa2ae540d18e3408c96e42e5fa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:04.787825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:04.788370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:04.788370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:04.827669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:04.828929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:04.905331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:04.934353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1128/2230] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:04.942105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:04.942511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:04.942694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:04.974096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:04.975816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:04.989396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1103/2231] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:04.994123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.013180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ac99e-a15b-4307-999f-9c671007178d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.024305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.025456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.025833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.026464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.027164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:05.027537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.029586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.081508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1129/2232] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:26:05.085780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.097643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e341f-da2b-469d-89f7-a99bdc5beca0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.110769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.111419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.111739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.112018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.112790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.117067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.163139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1104/2233] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:05 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:05.165526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.188649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63e54-d7d2-40ff-a5fa-2fa12d8583f5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.349440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.350077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.350391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.350962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.351645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.353543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.409344 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.414347 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1130/2234] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:05 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:05.420067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1e9fe-eb66-48fe-a8e7-2bc0303e8e4b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.433620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.434278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.434567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.434849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.439325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.446829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.477807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1105/2235] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:26:05.482446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.498855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2eab-6b97-433e-912d-981adf95f0c5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.518184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.522063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.523141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.529762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.537344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.541857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7945-008e-4c2b-b12f-5bf55e2d4529 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.579239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1131/2236] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:05.580989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:05.606768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f06976-9d52-44ec-b73b-ab850d0856e2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:05.626341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:05.627512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.627890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.628277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] PATH_INFO: `/v3/projects/9e79f91e31fd4c9a91d56ad5eac195d0/users/3557350479f544349a598924677b8d1d/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.678439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e79f91e31fd4c9a91d56ad5eac195d0, user_id=3557350479f544349a598924677b8d1d, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:05.684195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:05.722281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1106/2237] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:05 2022] PUT /identity/v3/projects/9e79f91e31fd4c9a91d56ad5eac195d0/users/3557350479f544349a598924677b8d1d/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:26:05.728147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:05.728474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:05.728728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:05.786643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] MFA Rules not processed for user `3557350479f544349a598924677b8d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:05.788064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:05.924530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1132/2238] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:05.928514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.052538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37865f5-b148-443b-99e0-3f2d14476c79 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.062662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.063298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.063579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.064035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.064811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.067405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.152408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1107/2239] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:05 2022] POST /identity/v3/projects => generated 393 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:06.152990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.169087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072e676-da90-42db-8466-bbf1eefe30dc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.328111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:06.390126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.391345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.391842 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.392497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.394874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.400947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.443932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1133/2240] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:06 2022] POST /identity/v3/users => generated 303 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:06.445384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.457609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c165209-5b1b-4b22-918c-cc61b6806240 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.476781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.477349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.477630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.477904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.479049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.481092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.506788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.509632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1108/2241] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:06.523918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43275d-a79e-4f02-bc66-5dd2d9a51e87 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.530813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.531557 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.531837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.532173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] PATH_INFO: `/v3/projects/01447a81d734412c8226779779ad5a96/users/4be9e6766b524bb3b7e55f9ede00d367/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.560582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01447a81d734412c8226779779ad5a96, user_id=4be9e6766b524bb3b7e55f9ede00d367, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.567548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.606989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1134/2242] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:06 2022] PUT /identity/v3/projects/01447a81d734412c8226779779ad5a96/users/4be9e6766b524bb3b7e55f9ede00d367/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:06.608581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.623163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb06a-e1e8-4a91-9b46-d3bc22c2e39a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.651494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:06.738512 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.739587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.739874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.740348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.741147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.743625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d709170-6fb5-4535-99a2-15a88dacfe28 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.772810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1109/2243] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:06.776683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:06.790678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4d43-4645-49f1-ba61-5c2d15157b6f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:06.820504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:06.821357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.821844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.822947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] PATH_INFO: `/v3/projects/01447a81d734412c8226779779ad5a96/users/4be9e6766b524bb3b7e55f9ede00d367/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.830315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01447a81d734412c8226779779ad5a96, user_id=4be9e6766b524bb3b7e55f9ede00d367, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:06.833284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:06.863128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1135/2244] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:06 2022] PUT /identity/v3/projects/01447a81d734412c8226779779ad5a96/users/4be9e6766b524bb3b7e55f9ede00d367/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:06.876364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:06.876659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:06.876943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:06.947412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] MFA Rules not processed for user `4be9e6766b524bb3b7e55f9ede00d367`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:06.948831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:07.102572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1110/2245] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:07.118766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:07.121097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:07.248154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb3255-bb44-4ed9-bca1-04fdea3b8576 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:07.259327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:07.260981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:07.266924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:07.267170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:07.284914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:07.288649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c6614-ba2d-4175-a5bf-709ae4d0243d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:07.310895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1136/2246] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:07.387762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:07.390702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:07.434105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6237-52fa-42b0-adf4-44c4f65ddb41 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:07.443482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:07.445193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:07.445193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:07.445193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:07.573252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:07.574901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:07.601327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1111/2247] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:10.169612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:10.170504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:10.171483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:10.187975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:10.190195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:10.220709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] MFA Rules not processed for user `f8fb2911923d4117b6358ef0d41b89bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:10.222696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:10.262470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:10.302583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995d63-6562-4a69-9cf6-70eb00a81e95 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:10.307391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:10.308550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:10.308550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:10.308749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] PATH_INFO: `/v3/users/254d380de4ae4533afeaf10701f70ab6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:10.309983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] RBAC: Authorizing `identity:delete_user(user_id=254d380de4ae4533afeaf10701f70ab6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:10.313709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:10.323578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1137/2248] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:10.337981 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:10.339531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:10.372278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254d380de4ae4533afeaf10701f70ab6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:10.373003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254d380de4ae4533afeaf10701f70ab6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:10.373134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:10.373619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254d380de4ae4533afeaf10701f70ab6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:10.381842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254d380de4ae4533afeaf10701f70ab6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:10.407022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254d380de4ae4533afeaf10701f70ab6'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:10.431375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1112/2249] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:10 2022] DELETE /identity/v3/users/254d380de4ae4533afeaf10701f70ab6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:26:10.472724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9494-c758-4b1e-aac6-2a987758436d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:10.613307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:10.613947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:10.614256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:10.614828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:10.617145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:10.762004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:10.763666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:10.766000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:10.768433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:10.775099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1138/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:10.971229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16fb1-8b20-4deb-8595-a20756a8406b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:10.982186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:10.983245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:10.983721 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:10.984171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] PATH_INFO: `/v3/projects/36dce760b40e4b4c9ebefb535bda6173` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:10.986952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36dce760b40e4b4c9ebefb535bda6173)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:10.989331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:11.137087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36dce760b40e4b4c9ebefb535bda6173', 'request_id': 'req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.151144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36dce760b40e4b4c9ebefb535bda6173', 'request_id': 'req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.164190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36dce760b40e4b4c9ebefb535bda6173', 'request_id': 'req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.165943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:11.181823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] The token cache is being invalidate because project 36dce760b40e4b4c9ebefb535bda6173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:11.182463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.183212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.185379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1113/2251] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:10 2022] DELETE /identity/v3/projects/36dce760b40e4b4c9ebefb535bda6173 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:26:11.189198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:11.205607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396214b1-48db-4ffc-b42d-c4202a2fd301 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:11.283309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:11.291571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:11.292240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:11.292523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:11.292809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] PATH_INFO: `/v3/users/39f1951e8052489680eab1767f310ad3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:11.294722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f1951e8052489680eab1767f310ad3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:11.296845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:11.367982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f1951e8052489680eab1767f310ad3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.368644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f1951e8052489680eab1767f310ad3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.380814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f1951e8052489680eab1767f310ad3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.407191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f1951e8052489680eab1767f310ad3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.414919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-54efe41e-3441-4a69-b7e9-5d864a5b6037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f1951e8052489680eab1767f310ad3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.421970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1139/2252] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:11 2022] DELETE /identity/v3/users/39f1951e8052489680eab1767f310ad3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:26:11.678432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:11.680020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:11.718892 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcae50-12a3-4ea6-a0d7-ec6669e2492b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:11.782760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:11.783272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:11.783551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:11.783820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] PATH_INFO: `/v3/projects/21d1183a69654d839e45e122530994e6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:11.784976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d1183a69654d839e45e122530994e6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:11.786936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:11.866708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d1183a69654d839e45e122530994e6', 'request_id': 'req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.875645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d1183a69654d839e45e122530994e6', 'request_id': 'req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.881864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d1183a69654d839e45e122530994e6', 'request_id': 'req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.898377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] The token cache is being invalidate because project 21d1183a69654d839e45e122530994e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:11.898875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.899648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-faf2f1c0-c78e-4d68-b66e-7d75b784c5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:11.901371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1114/2253] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:11 2022] DELETE /identity/v3/projects/21d1183a69654d839e45e122530994e6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:11.906953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:11.907192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:11.907491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:11.931464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:11.933260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:12.025186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1140/2254] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:12.032704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.033043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.033440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.069021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:12.071181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:12.082442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1115/2255] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:12.087626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.104584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719ce0-6c7a-4bcd-809c-5b2d7219ab85 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.111458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.112387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.112664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.112928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.113583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:12.113882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.115855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.138753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1141/2256] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:26:12.139975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.149966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b512ad-41ef-4446-87c9-cb9c567d2d26 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.154830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.156110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.156479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.156756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.157393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.159343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c3abb-8395-4672-94c9-c08c1dbf6cee admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.189174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1116/2257] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:12.193590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.204772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1c19-3dca-48a3-af44-4f4bb9282c9d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.216413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.216702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.216970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.237294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] MFA Rules not processed for user `340b906fc22b4ad38e1fddc26f7750df`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:12.238635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:12.267412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.268087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.268364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.268632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.269267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.271851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.282167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:12.288345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:12.297871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1142/2258] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:12 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:12.298614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1117/2259] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:12.301883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.312353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3675dac-05f1-463e-89f0-d12dde88ab2c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.317669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.317850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.318121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.318418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.319063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.320726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.335015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1143/2260] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:26:12.339002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.352529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090a8fc-1056-4da5-8f1a-98c5c254b252 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.357402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.357973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.358368 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.358756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.359401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.361000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7aabf-3f8e-4292-8a6d-c950f0dc4b71 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.374268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1118/2261] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:12.375978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.386202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3961a-076e-47fe-8175-8b007fcea392 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.395307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.395984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.396265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.396540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] PATH_INFO: `/v3/projects/14bbc982a22b4598a2ee53b8e07842cb/users/91463d52e62047529f4a52d42a45c5ab/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.414194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bbc982a22b4598a2ee53b8e07842cb, user_id=91463d52e62047529f4a52d42a45c5ab, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.417051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.431776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1144/2262] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:12 2022] PUT /identity/v3/projects/14bbc982a22b4598a2ee53b8e07842cb/users/91463d52e62047529f4a52d42a45c5ab/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:12.442710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.443171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.443729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.488084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] MFA Rules not processed for user `91463d52e62047529f4a52d42a45c5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:12.489413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:12.584786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1119/2263] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:26:12.600865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:12.602881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:12.699624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b25fb-fc20-4f67-a17c-147453989eb6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:12.712134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:12.712952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:12.713238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:12.713822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:12.734611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:12.736852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa99628-df74-4dfb-88e7-ff57b9ceda01 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:12.771830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1145/2264] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:13.069383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:13.071271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:13.204690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c64b9-1185-4285-9862-5ed972fb6aa0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:13.209573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:13.210243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:13.210537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:13.210815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] PATH_INFO: `/v3/users/3557350479f544349a598924677b8d1d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:13.212799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3557350479f544349a598924677b8d1d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:13.224832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:13.297519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3557350479f544349a598924677b8d1d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.298410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3557350479f544349a598924677b8d1d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.299136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3557350479f544349a598924677b8d1d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.307689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3557350479f544349a598924677b8d1d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.325478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3557350479f544349a598924677b8d1d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.330782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:13.343404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1120/2265] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:13 2022] DELETE /identity/v3/users/3557350479f544349a598924677b8d1d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:13.347878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:13.348370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:13.348451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:13.368250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:13.369450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:13.442558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1146/2266] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:13.446724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:13.448520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:13.518370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0e32c-234d-4e8e-ba2c-f100665eea4a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:13.522809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:13.523491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:13.523866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:13.524148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:13.534466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:13.535907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:13.551579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1121/2267] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:13.854694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:13.856284 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:13.873077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bca050-856b-42e7-99a1-13e96ba7b57e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:13.878490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:13.879256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:13.879606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:13.879954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] PATH_INFO: `/v3/projects/9e79f91e31fd4c9a91d56ad5eac195d0` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:13.881161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e79f91e31fd4c9a91d56ad5eac195d0)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:13.883198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:13.947064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e79f91e31fd4c9a91d56ad5eac195d0', 'request_id': 'req-5e92a29a-203e-46b5-8d65-41658d6d6f68'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.954542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e79f91e31fd4c9a91d56ad5eac195d0', 'request_id': 'req-5e92a29a-203e-46b5-8d65-41658d6d6f68'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.955877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:13.962069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e79f91e31fd4c9a91d56ad5eac195d0', 'request_id': 'req-5e92a29a-203e-46b5-8d65-41658d6d6f68'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.977984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] The token cache is being invalidate because project 9e79f91e31fd4c9a91d56ad5eac195d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:13.978309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.978977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:13.980459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1147/2268] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:13 2022] DELETE /identity/v3/projects/9e79f91e31fd4c9a91d56ad5eac195d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:13.985504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:13.995652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50a6c-9413-4646-8fe1-38a4013d6d8b service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:14.073130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:14.073813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:14.074038 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:14.074352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] PATH_INFO: `/v3/users/4be9e6766b524bb3b7e55f9ede00d367` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:14.075515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be9e6766b524bb3b7e55f9ede00d367)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:14.077636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:14.134085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be9e6766b524bb3b7e55f9ede00d367'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.134768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be9e6766b524bb3b7e55f9ede00d367'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.135477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be9e6766b524bb3b7e55f9ede00d367'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.143338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be9e6766b524bb3b7e55f9ede00d367'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.155677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-ce3aae2b-f950-4054-979b-23a1aaf749de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be9e6766b524bb3b7e55f9ede00d367'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.170409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1122/2269] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:13 2022] DELETE /identity/v3/users/4be9e6766b524bb3b7e55f9ede00d367 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:14.631071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:14.633558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:14.650500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92a29a-203e-46b5-8d65-41658d6d6f68 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:14.747762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:14.748581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:14.749819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:14.750432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] PATH_INFO: `/v3/projects/01447a81d734412c8226779779ad5a96` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:14.752009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01447a81d734412c8226779779ad5a96)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:14.754281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:14.831222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01447a81d734412c8226779779ad5a96', 'request_id': 'req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.840824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01447a81d734412c8226779779ad5a96', 'request_id': 'req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.848281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01447a81d734412c8226779779ad5a96', 'request_id': 'req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.871141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] The token cache is being invalidate because project 01447a81d734412c8226779779ad5a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:14.871445 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.872175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-eef7192e-5bb8-442f-88cd-1d06bdf86b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:14.879946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1148/2270] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:14 2022] DELETE /identity/v3/projects/01447a81d734412c8226779779ad5a96 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:14.884982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:14.885189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:14.885463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:14.907506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:14.908846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:14.935950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:15.026429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1123/2271] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:15.041298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.041772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.042287 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.065022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:15.066312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:15.081494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1149/2272] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:15.085778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.096480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77865bcb-33ed-4cf3-83d3-70b8a70b50a9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.101577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.102324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.102684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.103033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.103763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:15.104288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.105952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.119930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1124/2273] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:26:15.125123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.139074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ceed0-bbd0-439a-a497-0415d53f002a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.144881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.145592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.145871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.146143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.146848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.148759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.178186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1150/2274] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:15.182367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.193632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50955dd2-cacc-468f-a436-42fdb5268a2b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.257305 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.257921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.258200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.258509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.259158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.261161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.286053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1125/2275] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:26:15.290144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.300961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f1b28-0dd2-4871-bdc4-533b9cb82b53 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.306292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.306809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.307092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.307367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.308050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.309653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.322259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1151/2276] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:15.325895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.340066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a831dc-fac6-4f70-b810-a0c756a9b999 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.346396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.347170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.347294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.347578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.348231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.349852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb785d-4ab7-41be-b754-c0d01f35294f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.362049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1126/2277] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:15.366396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.381792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08650a-5470-4e48-b740-ec60281ad4e5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.387345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.388036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.388388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.388754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] PATH_INFO: `/v3/projects/dd925426ef3645f5ae254ad2d1bdf1cf/users/365390b3be4b459ba85244d670a98289/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.408422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd925426ef3645f5ae254ad2d1bdf1cf, user_id=365390b3be4b459ba85244d670a98289, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.411218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.427912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1152/2278] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:15 2022] PUT /identity/v3/projects/dd925426ef3645f5ae254ad2d1bdf1cf/users/365390b3be4b459ba85244d670a98289/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:15.439240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.439526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.439802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.472096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] MFA Rules not processed for user `365390b3be4b459ba85244d670a98289`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:15.473314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:15.545024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1127/2279] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:26:15.550111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.560068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:15.622369 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e30a8-8003-4e05-935f-a388f4eafcc9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.627961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.628568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.628851 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.629128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.629770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.631712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.658242 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1153/2280] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:15.662188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.674452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3c47-6701-4584-a3f7-f5ffda2d651c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.683165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:15.734999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.735605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.735882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.736186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.736788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.738726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.762265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1128/2281] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:15 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:15.766978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.777814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecaabb-16bb-40a0-b06a-c8004111b1f5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.783371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.784094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.784371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.784643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.785293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.787022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.799138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1154/2282] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:15.803270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.814531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95652230-2bf4-4b7f-97f3-041455d62f0f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.819480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.820285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.820567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.820837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] PATH_INFO: `/v3/projects/896a610fbdba4580bee436cee93696a6/users/03b53379ed4845aebdb700d0e8bb6558/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.844838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896a610fbdba4580bee436cee93696a6, user_id=03b53379ed4845aebdb700d0e8bb6558, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.847615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.863359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1129/2283] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:15 2022] PUT /identity/v3/projects/896a610fbdba4580bee436cee93696a6/users/03b53379ed4845aebdb700d0e8bb6558/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:15.867349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.879143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ff384-1a6d-4a81-8958-662d015785d2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.937280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.937880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.938159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.938459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.939499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.941280 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497d8f-cad3-4548-acab-f4b12ea4d77d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.953650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1155/2284] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:26:15.957868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:15.969062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb939-a972-4437-af8f-37e4cd0b0ef4 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:15.974744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:15.975632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:15.975743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:15.975937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] PATH_INFO: `/v3/projects/896a610fbdba4580bee436cee93696a6/users/03b53379ed4845aebdb700d0e8bb6558/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:15.978043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=896a610fbdba4580bee436cee93696a6, user_id=03b53379ed4845aebdb700d0e8bb6558, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:15.980810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:15.992768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1130/2285] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:15 2022] PUT /identity/v3/projects/896a610fbdba4580bee436cee93696a6/users/03b53379ed4845aebdb700d0e8bb6558/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:16.004156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.004450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.004802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:16.038885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] MFA Rules not processed for user `03b53379ed4845aebdb700d0e8bb6558`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:16.040097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:16.111163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1156/2286] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:16.122468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:16.124321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:16.180236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525c76-125c-48cf-9d26-4c6cc6ffb91b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:16.183943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:16.184547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.184823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.185088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:16.197832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:16.199238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:16.209885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1131/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:16.294970 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:16.301720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:16.306010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33e83-1b42-47d7-8944-f90be1bedda4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:16.310745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:16.311597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.312341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.312615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:16.370322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:16.371734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9ed8-7cf8-434a-b8de-cf33845f6149 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:16.381449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1157/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:16.635814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:16.637281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:16.722707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4365a-d8f5-4644-a870-f92f84bdbd57 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:16.727676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:16.728308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.728630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.728905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] PATH_INFO: `/v3/users/91463d52e62047529f4a52d42a45c5ab` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:16.730034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] RBAC: Authorizing `identity:delete_user(user_id=91463d52e62047529f4a52d42a45c5ab)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:16.732046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:16.746157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:16.783423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91463d52e62047529f4a52d42a45c5ab'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:16.784302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91463d52e62047529f4a52d42a45c5ab'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:16.785076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91463d52e62047529f4a52d42a45c5ab'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:16.798480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91463d52e62047529f4a52d42a45c5ab'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:16.810837 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91463d52e62047529f4a52d42a45c5ab'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:16.824720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1132/2289] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:16 2022] DELETE /identity/v3/users/91463d52e62047529f4a52d42a45c5ab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:16.832817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.833334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.833427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:16.853014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:16.854233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:16.922471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1158/2290] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:16.929665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:16.931209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:16.991041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c54db-e2e6-425d-a914-c052c87265db admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:16.994751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:16.995367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:16.995646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:16.995922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.005569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.007036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdd77d-c4ac-49f4-a2e5-a8a6d995ab79 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:17.017209 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1133/2291] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:17.522526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:17.524013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:17.537530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b357bc-c61e-4b3e-bbeb-35ec06b93249 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:17.543244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:17.543892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.544186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.544452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] PATH_INFO: `/v3/projects/14bbc982a22b4598a2ee53b8e07842cb` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.545848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bbc982a22b4598a2ee53b8e07842cb)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.548633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:17.595778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bbc982a22b4598a2ee53b8e07842cb', 'request_id': 'req-e82f64cd-05a1-400a-a0bc-42f19a2059e4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:17.601778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bbc982a22b4598a2ee53b8e07842cb', 'request_id': 'req-e82f64cd-05a1-400a-a0bc-42f19a2059e4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:17.607782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bbc982a22b4598a2ee53b8e07842cb', 'request_id': 'req-e82f64cd-05a1-400a-a0bc-42f19a2059e4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:17.620968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] The token cache is being invalidate because project 14bbc982a22b4598a2ee53b8e07842cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:17.621263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:17.621928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e82f64cd-05a1-400a-a0bc-42f19a2059e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:17.623805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1159/2292] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:17 2022] DELETE /identity/v3/projects/14bbc982a22b4598a2ee53b8e07842cb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:17.629157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.630291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.630572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.650581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:17.651771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:17.712165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1134/2293] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:17.721856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.722263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.722616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.743762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:17.745116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:17.753202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1160/2294] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:17.757426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:17.767811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5facad8-2583-47a0-ba7c-94ce20b5913d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:17.772398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:17.773007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.773286 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.773560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.774206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:17.774547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.776129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:17.788467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1135/2295] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:26:17.792885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:17.802425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a406a-988c-4a7a-a9e8-954688053cef None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:17.807232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:17.807831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.808106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.808375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.809020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.810939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:17.847174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:17.861729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1161/2296] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:17 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:17.862854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:17.874033 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4dcfe-ab6f-4397-bc4a-e748d52e98e7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:17.887354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:17.942136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:17.943181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.943490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.943732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.944425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.946407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:17.973102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1136/2297] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:17 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:26:17.977429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:17.988285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f848-819b-4398-8d22-dc34e00e5180 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:17.994076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:17.994716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:17.994999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:17.995272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:17.995925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:17.997732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:18.010294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1162/2298] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:18.014110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:18.024759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebf14d-b865-4b59-a7f7-c9ebade1012c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:18.029588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:18.030321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:18.030609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:18.030878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:18.031519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:18.033113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693b03c-d55d-40c1-86d6-a919e9c9de2a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:18.049411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1137/2299] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:18.050799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:18.063248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af608db9-d015-4086-bdc8-a280d0de6362 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:18.070865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:18.071492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:18.071710 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:18.072241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] PATH_INFO: `/v3/projects/48a4e61c90ea4363bcb5bd4790bdf9c8/users/2d66fd90fe9948a089acdc3be0607d66/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:18.091841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a4e61c90ea4363bcb5bd4790bdf9c8, user_id=2d66fd90fe9948a089acdc3be0607d66, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:18.096401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:18.114378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1163/2300] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:18 2022] PUT /identity/v3/projects/48a4e61c90ea4363bcb5bd4790bdf9c8/users/2d66fd90fe9948a089acdc3be0607d66/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:26:18.125101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:18.125529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:18.125711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:18.156503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] MFA Rules not processed for user `2d66fd90fe9948a089acdc3be0607d66`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:18.157904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:18.243407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1138/2301] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:18.255164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:18.256969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:18.320341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0912d3-f8d5-498a-bfca-2db3cf498037 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:18.324066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:18.324672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:18.324953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:18.325224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:18.335034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:18.336497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e0f6-470b-436a-834a-6991ddb0f42c service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:18.345748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1164/2302] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:21.344990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:21.346515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:21.421337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e71925-8d14-4776-894e-b0d7482bb99b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:21.426637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:21.427270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:21.427549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:21.427826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] PATH_INFO: `/v3/users/365390b3be4b459ba85244d670a98289` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:21.428980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=365390b3be4b459ba85244d670a98289)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:21.430972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:21.460163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:21.480290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365390b3be4b459ba85244d670a98289'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:21.480942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365390b3be4b459ba85244d670a98289'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:21.481559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365390b3be4b459ba85244d670a98289'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:21.488499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365390b3be4b459ba85244d670a98289'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:21.500993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365390b3be4b459ba85244d670a98289'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:21.513501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1139/2303] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:21 2022] DELETE /identity/v3/users/365390b3be4b459ba85244d670a98289 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:21.518604 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:21.519089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:21.519184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:21.539774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:21.540999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:21.603395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1165/2304] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:21.613464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:21.614888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:21.671127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368ee9c-deff-4089-87ff-631106eab9b7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:21.674606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:21.675200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:21.675472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:21.675739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:21.684745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:21.686256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:21.697161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1140/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:21.972252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:21.973697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:21.997802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e2d5-5d2c-4aae-a304-d1d74722f047 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:22.005378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:22.006272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.006502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.006861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] PATH_INFO: `/v3/projects/dd925426ef3645f5ae254ad2d1bdf1cf` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.008029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd925426ef3645f5ae254ad2d1bdf1cf)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:22.009832 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:22.080596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd925426ef3645f5ae254ad2d1bdf1cf', 'request_id': 'req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.087116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd925426ef3645f5ae254ad2d1bdf1cf', 'request_id': 'req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.091860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:22.094753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd925426ef3645f5ae254ad2d1bdf1cf', 'request_id': 'req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.108619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] The token cache is being invalidate because project dd925426ef3645f5ae254ad2d1bdf1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:22.108909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.110179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.111878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1166/2306] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:21 2022] DELETE /identity/v3/projects/dd925426ef3645f5ae254ad2d1bdf1cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:22.115936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:22.126431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f1905-21bf-4dbb-b099-281666cb29bc service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:22.187293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:22.188449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.188710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.188980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] PATH_INFO: `/v3/users/03b53379ed4845aebdb700d0e8bb6558` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.190096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b53379ed4845aebdb700d0e8bb6558)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:22.192070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:22.237670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b53379ed4845aebdb700d0e8bb6558'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.238354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b53379ed4845aebdb700d0e8bb6558'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.238998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b53379ed4845aebdb700d0e8bb6558'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.240909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:22.248283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b53379ed4845aebdb700d0e8bb6558'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.262568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f652d35c-295a-4888-b0c9-52b76c870044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b53379ed4845aebdb700d0e8bb6558'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.275568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1141/2307] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:22 2022] DELETE /identity/v3/users/03b53379ed4845aebdb700d0e8bb6558 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:22.567510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:22.569386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:22.589819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0bd3b-afe8-4b5d-ad78-e00087dd7aad admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:22.657745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:22.658419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.658697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.658969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] PATH_INFO: `/v3/projects/896a610fbdba4580bee436cee93696a6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.660103 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] RBAC: Authorizing `identity:delete_project(project_id=896a610fbdba4580bee436cee93696a6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:22.661993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:22.708483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896a610fbdba4580bee436cee93696a6', 'request_id': 'req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.714582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896a610fbdba4580bee436cee93696a6', 'request_id': 'req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.720405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896a610fbdba4580bee436cee93696a6', 'request_id': 'req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.733650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] The token cache is being invalidate because project 896a610fbdba4580bee436cee93696a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:22.734413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.735193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8d5f8fb9-6763-4009-af84-ba4c0d0c201c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:22.736673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1167/2308] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:22 2022] DELETE /identity/v3/projects/896a610fbdba4580bee436cee93696a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:22.741819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.742307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.742307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.763513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:22.764792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:22.825314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1142/2309] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:26:22.834074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.834743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.835049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.856623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:22.857847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:22.866051 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1168/2310] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:22.870437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:22.880125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9612a-aa20-47f0-8aa1-b62acf17539d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:22.884625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:22.885216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.885496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.885768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.886432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:22.886735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:22.888318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:22.900156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1143/2311] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:26:22.904402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:22.914447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b8ba9-69b9-49db-b462-bf51d6b490ec None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:22.919251 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:22.919850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:22.920136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:22.920411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:22.921087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:22.923821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:22.949690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1169/2312] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:22 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:22.954662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:22.964485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ede05-3718-4f1d-bc28-e02c8ce83555 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.020051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.020576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.020878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.021152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.021770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.023701 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.043789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1144/2313] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:22 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:23.048182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.058353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7711-15e1-4481-84f9-e3572cc9997d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.063004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.063590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.063863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.064129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.064767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.066362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.075996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1170/2314] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:23.080363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.091073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac5ab6-3cbe-4499-abea-7d1f27f56813 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.096609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.097210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.097490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.097763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.098451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.100041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55db0c-3c34-401e-8268-4455ff89f04c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.111256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1145/2315] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:23.115458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.125784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ad0fa-627f-4f56-92e5-36a6609ae1fe admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.131839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.132634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.133429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.133429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] PATH_INFO: `/v3/projects/1703f70a40e748edad7eca4788d9f302/users/10c31e72b7cb46af8322bab735ef1cd2/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.150674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1703f70a40e748edad7eca4788d9f302, user_id=10c31e72b7cb46af8322bab735ef1cd2, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.153318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.167113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1171/2316] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:23 2022] PUT /identity/v3/projects/1703f70a40e748edad7eca4788d9f302/users/10c31e72b7cb46af8322bab735ef1cd2/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:23.177472 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.177641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.177917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.212632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] MFA Rules not processed for user `10c31e72b7cb46af8322bab735ef1cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:23.214806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:23.240256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:23.292868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1146/2317] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:23.297389 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.327304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:23.383839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50940d91-4812-4561-b7cc-0955252de5c7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.389039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.389692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.390003 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.390399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.391822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.400148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.437999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1172/2318] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:23 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:23.439211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.450258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fd583-0047-4a84-9bee-9d9ee56bb40d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.518719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.519533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.519819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.520197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.520848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.523137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.551960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1147/2319] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:23 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:23.555903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.583151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5762-d0da-4ca5-a724-86e470e73726 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.587979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.588595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.589022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.589304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.589991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.591639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.603225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1173/2320] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:23.607637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.620734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebeddd-d587-4977-b7a0-d25a0417730a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.626338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.627042 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.627322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.627598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] PATH_INFO: `/v3/projects/b06c85472ec648c1835a7c6a80939f9f/users/a7ff8c7bec024080a6bedaa82157b59d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.644104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06c85472ec648c1835a7c6a80939f9f, user_id=a7ff8c7bec024080a6bedaa82157b59d, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.646802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.659825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1148/2321] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:23 2022] PUT /identity/v3/projects/b06c85472ec648c1835a7c6a80939f9f/users/a7ff8c7bec024080a6bedaa82157b59d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:23.663678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.674439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba04b8-0100-48d6-a04e-1e7f52f13b60 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.738583 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.739202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.739485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.739769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.740414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.742005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030500c2-3348-4f02-83b3-434985c2d2a2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.753065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1174/2322] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:23.757338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.768008 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeb432-6ab5-422b-9bca-71a6820fe49e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:23.772788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:23.773569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.773969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.774451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] PATH_INFO: `/v3/projects/b06c85472ec648c1835a7c6a80939f9f/users/a7ff8c7bec024080a6bedaa82157b59d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.776436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06c85472ec648c1835a7c6a80939f9f, user_id=a7ff8c7bec024080a6bedaa82157b59d, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:23.779223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:23.789664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1149/2323] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:23 2022] PUT /identity/v3/projects/b06c85472ec648c1835a7c6a80939f9f/users/a7ff8c7bec024080a6bedaa82157b59d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:23.860598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:23.860888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:23.861172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:23.889890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] MFA Rules not processed for user `a7ff8c7bec024080a6bedaa82157b59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:23.891674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:23.958706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1175/2324] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:23.969652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:23.971526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:24.032170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefdf21-c0f2-48e1-954b-849c3373bcb8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:24.035927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:24.036534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:24.036845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:24.037162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:24.066995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:24.095544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:24.096985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:24.105868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1150/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:31.703015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:31.716816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640550a-a612-4b23-ab18-9db5924d0939 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:31.721535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:31.722144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:31.722446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:31.722718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:31.733923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:31.735995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4c40-517a-4c9e-a080-b4202e39cc0e service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:31.739977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:31.747485 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1176/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:32.762730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:32.764234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:32.850186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3b52a-74c2-41f7-ae6e-cc0daf17bd57 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:32.854833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:32.855467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:32.855745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:32.856017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] PATH_INFO: `/v3/users/30e4084ddef74c7cb2aa913b267d8a13` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:32.857135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e4084ddef74c7cb2aa913b267d8a13)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:32.859116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:32.930591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e4084ddef74c7cb2aa913b267d8a13'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:32.931262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e4084ddef74c7cb2aa913b267d8a13'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:32.931867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e4084ddef74c7cb2aa913b267d8a13'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:32.940433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e4084ddef74c7cb2aa913b267d8a13'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:32.955764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e4084ddef74c7cb2aa913b267d8a13'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:32.968322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1151/2327] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:32 2022] DELETE /identity/v3/users/30e4084ddef74c7cb2aa913b267d8a13 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:32.973782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:32.974359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:32.974469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:32.993698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:32.994944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:33.070918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1177/2328] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:33.081788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:33.083814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:33.168586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:33.173630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0e975-1214-4211-87b6-4e65f2d0df50 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:33.178779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:33.179478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:33.179886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:33.180731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:33.192014 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:33.193392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:33.204217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1152/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:33.528355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:33.529927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:33.547771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490ff7-7c0d-4093-8516-ea86179a216b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:33.554294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:33.555041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:33.555395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:33.555743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] PATH_INFO: `/v3/projects/eb7f578a873e405e96151ba207547a4e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:33.556963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7f578a873e405e96151ba207547a4e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:33.559190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:33.617466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7f578a873e405e96151ba207547a4e', 'request_id': 'req-c1adc234-d329-40f3-abef-8303278b6e24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:33.624350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7f578a873e405e96151ba207547a4e', 'request_id': 'req-c1adc234-d329-40f3-abef-8303278b6e24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:33.631609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7f578a873e405e96151ba207547a4e', 'request_id': 'req-c1adc234-d329-40f3-abef-8303278b6e24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:33.645205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] The token cache is being invalidate because project eb7f578a873e405e96151ba207547a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:33.645508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:33.646293 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c1adc234-d329-40f3-abef-8303278b6e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:33.647942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1178/2330] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:33 2022] DELETE /identity/v3/projects/eb7f578a873e405e96151ba207547a4e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:36.717986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:36.719850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:36.732618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6a-7361-486d-a584-b1aecde3298f service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:36.792390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:36.793036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:36.793318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:36.793592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] PATH_INFO: `/v3/users/10c31e72b7cb46af8322bab735ef1cd2` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:36.794742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c31e72b7cb46af8322bab735ef1cd2)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:36.796666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:36.846489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c31e72b7cb46af8322bab735ef1cd2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:36.847186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c31e72b7cb46af8322bab735ef1cd2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:36.847792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c31e72b7cb46af8322bab735ef1cd2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:36.855405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c31e72b7cb46af8322bab735ef1cd2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:36.867763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c31e72b7cb46af8322bab735ef1cd2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:36.886555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1153/2331] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:36 2022] DELETE /identity/v3/users/10c31e72b7cb46af8322bab735ef1cd2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:36.891071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:36.891573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:36.891673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:36.911357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:36.912605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:36.973704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1179/2332] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:36.983343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:36.984824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:37.043659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd2cb3-8b30-4441-9db5-544e131bfcca admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:37.047366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:37.047974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:37.048259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:37.048530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:37.057999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:37.059471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:37.069838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1154/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:37.347939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:37.349360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:37.362153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842e4a-48a4-4a22-b4fc-052505622100 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:37.367374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:37.368078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:37.368425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:37.368837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] PATH_INFO: `/v3/projects/1703f70a40e748edad7eca4788d9f302` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:37.369886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1703f70a40e748edad7eca4788d9f302)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:37.371923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:37.391503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:37.422898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1703f70a40e748edad7eca4788d9f302', 'request_id': 'req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.429820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1703f70a40e748edad7eca4788d9f302', 'request_id': 'req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.435373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1703f70a40e748edad7eca4788d9f302', 'request_id': 'req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.447674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] The token cache is being invalidate because project 1703f70a40e748edad7eca4788d9f302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:37.447959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.448562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.450023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1180/2334] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:37 2022] DELETE /identity/v3/projects/1703f70a40e748edad7eca4788d9f302 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:37.454164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:37.464881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5a90-0368-4467-b691-1a7df0cf02c0 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:37.475573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:37.534069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:37.535051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:37.535330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:37.535608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] PATH_INFO: `/v3/users/a7ff8c7bec024080a6bedaa82157b59d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:37.536774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ff8c7bec024080a6bedaa82157b59d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:37.538746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:37.589884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ff8c7bec024080a6bedaa82157b59d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.590549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ff8c7bec024080a6bedaa82157b59d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.591152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ff8c7bec024080a6bedaa82157b59d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.601121 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ff8c7bec024080a6bedaa82157b59d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.614480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3248634c-a41e-4e8c-9052-f4d97f7be27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ff8c7bec024080a6bedaa82157b59d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:37.630262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1155/2335] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:37 2022] DELETE /identity/v3/users/a7ff8c7bec024080a6bedaa82157b59d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:37.912681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:37.915364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:37.929503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa5aa-dca2-4d36-ae2c-940c7c5a188c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:37.991089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:37.991724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:37.992001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:37.992273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] PATH_INFO: `/v3/projects/b06c85472ec648c1835a7c6a80939f9f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:37.993393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06c85472ec648c1835a7c6a80939f9f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:37.995334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.041882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06c85472ec648c1835a7c6a80939f9f', 'request_id': 'req-8122c361-a4d4-49b5-b870-b00df34d7a78'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.048042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06c85472ec648c1835a7c6a80939f9f', 'request_id': 'req-8122c361-a4d4-49b5-b870-b00df34d7a78'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.053669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06c85472ec648c1835a7c6a80939f9f', 'request_id': 'req-8122c361-a4d4-49b5-b870-b00df34d7a78'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.067269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] The token cache is being invalidate because project b06c85472ec648c1835a7c6a80939f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:38.067561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.068203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8122c361-a4d4-49b5-b870-b00df34d7a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.069684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1181/2336] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:37 2022] DELETE /identity/v3/projects/b06c85472ec648c1835a7c6a80939f9f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:38.075588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.076090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.076191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.098639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:38.100020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:38.163081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1156/2337] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:38.171567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.172057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.172399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.193594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:38.194833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:38.202814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1182/2338] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:38.207613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.218507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4a549-c80d-4e54-92b7-a8c69d3ad001 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.223795 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.224401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.224682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.224954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.225601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:26:38.225904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.227552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.239358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1157/2339] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:26:38.243962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.253620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb61b4-e15f-4d6d-b1ec-73927c51db05 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.258259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.258858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.259133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.259401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.260037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.262151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.291962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1183/2340] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:38.296202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.306656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ff5ed-002a-4eab-a1fa-3cd1950b13d5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.323274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:38.367401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.367856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.368140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.368417 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.369068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.371173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.392828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1158/2341] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:26:38.399067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.411013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3151-a3a2-4a8c-b3d2-703dea3e2497 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.415715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.416321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.416598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.416870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.417514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.419140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.420364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:38.431502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1184/2342] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:38.435301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.446654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68be6-7483-43af-b03a-53a23e8273b5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.451230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.451816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.452097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.452364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.452994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.454623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389621-20da-4b3a-8524-bdee8adb256c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.469550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1159/2343] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:26:38.472341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.482468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14215a0-7452-4dc1-912f-9aaef9b76e4a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.488468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.489140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.489462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.489735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] PATH_INFO: `/v3/projects/ef8b461ef24941f992e916ec2c822f6f/users/c34b9a64d76a492cbc3fbcbb0ef4986d/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.506358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8b461ef24941f992e916ec2c822f6f, user_id=c34b9a64d76a492cbc3fbcbb0ef4986d, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.510721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.523476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1185/2344] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:26:38 2022] PUT /identity/v3/projects/ef8b461ef24941f992e916ec2c822f6f/users/c34b9a64d76a492cbc3fbcbb0ef4986d/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:38.536035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.536325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.536600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.567771 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] MFA Rules not processed for user `c34b9a64d76a492cbc3fbcbb0ef4986d`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:38.568992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:38.635859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1160/2345] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:38.648080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.649872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:38.709909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91662f9-304c-4279-b245-d311e529f3af admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.716853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.717489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.717911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.718241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.727815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.729401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed50b-cdb4-4066-8a75-c71b8de91ac6 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.740084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1186/2346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:38.761243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:38.826553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7760d81-a042-4d5d-a539-284f91058406 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:38.831903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:38.832536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.832818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.833095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] PATH_INFO: `/v3/users/c34b9a64d76a492cbc3fbcbb0ef4986d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.834558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34b9a64d76a492cbc3fbcbb0ef4986d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:38.836201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:38.872132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:38.886802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34b9a64d76a492cbc3fbcbb0ef4986d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.887567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34b9a64d76a492cbc3fbcbb0ef4986d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.888198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34b9a64d76a492cbc3fbcbb0ef4986d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.895724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34b9a64d76a492cbc3fbcbb0ef4986d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.907505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34b9a64d76a492cbc3fbcbb0ef4986d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:38.921843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1161/2347] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:26:38 2022] DELETE /identity/v3/users/c34b9a64d76a492cbc3fbcbb0ef4986d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:38.926707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:38.927186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:38.927311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:38.946855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:26:38.948046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:39.010381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1187/2348] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:26:39.020723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:39.022124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:39.079895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045967d9-053a-49b0-a8fc-5831efcc9d6b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:39.084175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:39.084782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:39.085058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:39.085325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:39.094675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:39.096666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:39.106082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1162/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:26:39.379128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:26:39.380909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:26:39.402821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090fc6-a6c0-4bb5-952a-e4b79e770f89 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:26:39.407690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:26:39.409480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:26:39.409795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:26:39.410067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] PATH_INFO: `/v3/projects/ef8b461ef24941f992e916ec2c822f6f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:26:39.411881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8b461ef24941f992e916ec2c822f6f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:26:39.414002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:26:39.466792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8b461ef24941f992e916ec2c822f6f', 'request_id': 'req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:39.473814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8b461ef24941f992e916ec2c822f6f', 'request_id': 'req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:39.479361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8b461ef24941f992e916ec2c822f6f', 'request_id': 'req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:39.490905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:39.497605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] The token cache is being invalidate because project ef8b461ef24941f992e916ec2c822f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:26:39.497977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:39.498994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-68c09f5a-9b2b-4a4f-8cc5-2f211018c25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:26:39.500611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1188/2350] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:26:39 2022] DELETE /identity/v3/projects/ef8b461ef24941f992e916ec2c822f6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:26:49.101915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:49.499896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:08.495265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:08.496756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:08.509405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1d2e-4314-47ed-b947-fd2445895289 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:08.565565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:08.566185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:08.566493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:08.566763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] PATH_INFO: `/v3/users/2d66fd90fe9948a089acdc3be0607d66` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:08.567873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d66fd90fe9948a089acdc3be0607d66)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:08.569789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:08.619664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d66fd90fe9948a089acdc3be0607d66'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:08.620321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d66fd90fe9948a089acdc3be0607d66'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:08.620983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d66fd90fe9948a089acdc3be0607d66'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:08.627845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d66fd90fe9948a089acdc3be0607d66'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:08.639572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d66fd90fe9948a089acdc3be0607d66'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:08.657439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1163/2351] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:27:08 2022] DELETE /identity/v3/users/2d66fd90fe9948a089acdc3be0607d66 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:08.662095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:08.662635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:08.662740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:08.682380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:08.683780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:08.742520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1189/2352] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:08.752592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:08.754045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:08.811177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684785-e993-484e-8979-0f8eda90a6c8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:08.814882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:08.815490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:08.815769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:08.816040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:08.826063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:08.827535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6fc1-8799-4907-875a-489677b8fe75 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:08.837148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1164/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:27:09.176805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.178713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:09.195579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a8468-3b8f-41f7-ba94-3a5442a76a27 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.203036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.203679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.203979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.204252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] PATH_INFO: `/v3/projects/48a4e61c90ea4363bcb5bd4790bdf9c8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.205371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a4e61c90ea4363bcb5bd4790bdf9c8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.207299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.253022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a4e61c90ea4363bcb5bd4790bdf9c8', 'request_id': 'req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:09.259070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a4e61c90ea4363bcb5bd4790bdf9c8', 'request_id': 'req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:09.265125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a4e61c90ea4363bcb5bd4790bdf9c8', 'request_id': 'req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:09.277196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] The token cache is being invalidate because project 48a4e61c90ea4363bcb5bd4790bdf9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:27:09.277482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:09.278097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-efef5f3d-a713-4cd5-a3ee-d902b07ad1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:09.279580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1190/2354] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:27:09 2022] DELETE /identity/v3/projects/48a4e61c90ea4363bcb5bd4790bdf9c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:09.284371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.284657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.284930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.305510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:09.306672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:09.324826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:09.367659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1165/2355] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:09.377180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.377466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.377744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.397760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:09.399302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:09.407395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1191/2356] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:09.411713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.421414 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f38949-093f-474a-86d9-e40e95e2d1dc None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.426079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.426704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.426989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.427266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.427907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:27:09.428215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.429816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.441891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1166/2357] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:27:09.446245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.456335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb802c-5425-46b5-99a6-43bc76a20c3e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.461203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.461814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.462090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.462401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.463035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.465682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.493673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1192/2358] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:27:09 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:27:09.498783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.508842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288951a-badc-4405-a705-5cbaeb500784 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.565076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.565608 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.565889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.566162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.566819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.568734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.589844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1167/2359] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:27:09 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:27:09.594437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.605573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015235-4b1e-4d61-84d7-74def6c4fc60 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.610355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.610953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.611236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.611510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.612152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.613773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.624269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1193/2360] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:27:09.628088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.637874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e1423-2b32-4af6-b3bc-4d0a812c3431 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.642503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.643112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.643375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.643649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.644281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.645877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2147ca-3792-40c0-8f73-4c045be20c62 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.656369 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1168/2361] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:27:09.660258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.671147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b12cd6-fd8a-4e39-9273-ac857998a917 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.675770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.676416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.676698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.676976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] PATH_INFO: `/v3/projects/e45ecb1060744679b4b7fef45de9b483/users/3d0896fc286c45a88833f75dbb145581/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.692158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45ecb1060744679b4b7fef45de9b483, user_id=3d0896fc286c45a88833f75dbb145581, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.694845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.708095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1194/2362] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:27:09 2022] PUT /identity/v3/projects/e45ecb1060744679b4b7fef45de9b483/users/3d0896fc286c45a88833f75dbb145581/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:09.718250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.718539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.718809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.747824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] MFA Rules not processed for user `3d0896fc286c45a88833f75dbb145581`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:09.749015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:09.811989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1169/2363] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:09.823331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.825097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:09.847617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:09.883655 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20965-c62a-45db-9add-c0ceee92164e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.887388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:09.888008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:09.888285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:09.888554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:09.896526 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:09.897940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5cc3e5-d1b5-4221-8bff-277b0ae77f59 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:09.907098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1195/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:27:09.932522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:09.951039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:09.995250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a073f6-c7d0-4be1-b7f2-30f13d359e87 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:09.999831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.000451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.000729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.001000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] PATH_INFO: `/v3/users/3d0896fc286c45a88833f75dbb145581` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.002115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0896fc286c45a88833f75dbb145581)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.004065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.048489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0896fc286c45a88833f75dbb145581'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.049157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0896fc286c45a88833f75dbb145581'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.049778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0896fc286c45a88833f75dbb145581'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.056469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0896fc286c45a88833f75dbb145581'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.068297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0896fc286c45a88833f75dbb145581'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.080554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1170/2365] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:27:09 2022] DELETE /identity/v3/users/3d0896fc286c45a88833f75dbb145581 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:10.085312 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.085603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.085933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.109403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:10.110648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:10.174329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1196/2366] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:27:10.184296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.185694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:10.244429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497297da-7b49-43c7-b966-4460dabfd412 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.248921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.249530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.249815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.250087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.259299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.260726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d12823-9f3c-4c1c-96eb-a053a50c5a2c service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.269988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1171/2367] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:27:10.537002 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.538647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:10.552685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6692c52-eae3-420c-893b-03abbc9bcc03 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.557873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.559214 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.559431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.559886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] PATH_INFO: `/v3/projects/e45ecb1060744679b4b7fef45de9b483` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.561266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45ecb1060744679b4b7fef45de9b483)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.563099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.611264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45ecb1060744679b4b7fef45de9b483', 'request_id': 'req-5c7d8235-0c13-47b0-8161-9e75423f7984'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.617523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45ecb1060744679b4b7fef45de9b483', 'request_id': 'req-5c7d8235-0c13-47b0-8161-9e75423f7984'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.623426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45ecb1060744679b4b7fef45de9b483', 'request_id': 'req-5c7d8235-0c13-47b0-8161-9e75423f7984'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.635307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] The token cache is being invalidate because project e45ecb1060744679b4b7fef45de9b483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:27:10.635575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.636187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5c7d8235-0c13-47b0-8161-9e75423f7984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:27:10.637861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1197/2368] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:27:10 2022] DELETE /identity/v3/projects/e45ecb1060744679b4b7fef45de9b483 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:10.642982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.643470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.643573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.663235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:10.664493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:10.697645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:10.725188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1172/2369] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:10.733602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.734082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.734202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.754152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:10.755372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:10.763898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1198/2370] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:10.767979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.777529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e426c-431d-42fc-a0dc-784d521035ae None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.782068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.782723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.783003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.783275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.783921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:27:10.784253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.785853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.797253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1173/2371] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:27:10.801300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.812794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3e046-56e1-4a34-b2c0-b7f894d7e603 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.820216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.820823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.821099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.821367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.822004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.824643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.856947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1199/2372] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:27:10 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:27:10.858351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.868381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd7df0-d7f4-4cc7-8cda-445c409392f2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.926044 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.926743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.927024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.927298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.927921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.929828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.951728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1174/2373] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:27:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:27:10.955938 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.966052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cd7b-8cee-4efb-a509-c6c5524d0aab admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:10.970951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:10.971544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:10.971824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:10.972094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:10.972733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:10.974351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:10.984673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1200/2374] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:27:10.988490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:10.999114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d826-f961-4e89-be7a-b0b48c378c7a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:11.003718 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:11.004308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:11.004586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:11.004855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:11.005492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:11.007133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883ae4-2422-4998-8bb2-59866d0a6360 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:11.016976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1175/2375] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:27:11.021054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:11.031327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63f578-c578-4309-984c-4870e0e8fce1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:11.035926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:11.036564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:11.036844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:11.037118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] PATH_INFO: `/v3/projects/49a6109337a942c79584a0fa5219ca2d/users/aa7e39ed76504159bebf85b7ad4b7122/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:11.039317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:11.054642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a6109337a942c79584a0fa5219ca2d, user_id=aa7e39ed76504159bebf85b7ad4b7122, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:11.057286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:11.070277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1201/2376] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:27:11 2022] PUT /identity/v3/projects/49a6109337a942c79584a0fa5219ca2d/users/aa7e39ed76504159bebf85b7ad4b7122/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:27:11.075327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42433-209e-441a-b7c3-e682a45b6776 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:11.075613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42433-209e-441a-b7c3-e682a45b6776 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:11.075887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c42433-209e-441a-b7c3-e682a45b6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:11.094396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c6c42433-209e-441a-b7c3-e682a45b6776 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:11.095591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c6c42433-209e-441a-b7c3-e682a45b6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:11.154717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1176/2377] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:11.164271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:11.165969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:11.223370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808495-8fef-4feb-bb2d-6896fdf6ca38 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:11.227016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:11.227617 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:11.227899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:11.228178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:11.237717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:11.239164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:11.249088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1202/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:27:15.264973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.265445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.265547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.295307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] MFA Rules not processed for user `aa7e39ed76504159bebf85b7ad4b7122`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:15.296486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:15.330697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:15.365392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1177/2379] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:15.369821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.379946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a3db7-24eb-4ca9-995b-90a91d70e8ef service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.384687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.385296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.385575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.385848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.386643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.388414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.415420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1203/2380] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:27:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:27:15.420717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.431572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2b0e8-9f97-4a1d-ba8f-949dd7096b65 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.491686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.492300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.492580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.492848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.493491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.495460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.519830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1178/2381] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:27:15 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:27:15.523801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.535135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183473-dff1-4e11-9de8-c92523ec0d91 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.539817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.540424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.540703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.540977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.541646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.543487 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.554773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1204/2382] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:27:15.559229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.569363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6038-8c01-4cb0-8f86-4e606bdce3eb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.574742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.575443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.575722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.575996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] PATH_INFO: `/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a/users/f9a751be3426471b9d5c2a0ee5d34ecf/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.591906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fdb9c8859e4cd2a2592aa25afb875a, user_id=f9a751be3426471b9d5c2a0ee5d34ecf, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.594612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.608314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1179/2383] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:27:15 2022] PUT /identity/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a/users/f9a751be3426471b9d5c2a0ee5d34ecf/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:15.612334 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.622676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbf62b-7bac-4f3f-b1ae-495ec2289b41 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.688279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.688883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.689159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.689428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.690058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.691994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df409b6-2589-4c80-aadb-4d924a9b8fc1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.703785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1205/2384] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:27:15.708163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:15.719773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3dfa-0e96-4ce6-a25f-6f0d4126b00e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:15.724877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:15.725538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:15.725814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:15.726085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] PATH_INFO: `/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a/users/f9a751be3426471b9d5c2a0ee5d34ecf/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:15.728036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fdb9c8859e4cd2a2592aa25afb875a, user_id=f9a751be3426471b9d5c2a0ee5d34ecf, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:15.731075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:15.742888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1180/2385] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:27:15 2022] PUT /identity/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a/users/f9a751be3426471b9d5c2a0ee5d34ecf/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:27:20.349858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e455-3267-44cc-96a3-3ef58c527ee1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:20.350421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e455-3267-44cc-96a3-3ef58c527ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:20.350421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e455-3267-44cc-96a3-3ef58c527ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:20.379723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff26e455-3267-44cc-96a3-3ef58c527ee1 None None] MFA Rules not processed for user `f9a751be3426471b9d5c2a0ee5d34ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:20.380866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff26e455-3267-44cc-96a3-3ef58c527ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:20.421148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:20.457177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1206/2386] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:20.469960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:20.472372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:20.547080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae5213-243a-45bb-b7f4-3cddb104922f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:20.551217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:20.551838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:20.552609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:20.552609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:20.606906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:20.624529 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:20.628060 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:20.640998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1181/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:27:20.891611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4909-b5ae-4ef9-831c-a6365bf33a4e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:20.892675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4909-b5ae-4ef9-831c-a6365bf33a4e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:20.893154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4909-b5ae-4ef9-831c-a6365bf33a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:20.915568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c40e4909-b5ae-4ef9-831c-a6365bf33a4e None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:20.916898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c40e4909-b5ae-4ef9-831c-a6365bf33a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:20.984070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1207/2388] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:27:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:21.036484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:21.039177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:21.121872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763537-194b-4a0b-a291-2cbde0342a0b service glance] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:21.127131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:21.127832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:21.128215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:21.128556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:21.138434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:21.140499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1eaf98-e31a-4239-94cc-4fcaf55a6d7b service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:21.150310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1182/2389] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:27:30.976409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=37 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:31.147308 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=40 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:31.811068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e57a-e3b6-4f07-a5cb-39b5b2f8e819 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:31.811353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e57a-e3b6-4f07-a5cb-39b5b2f8e819 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:31.811626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e57a-e3b6-4f07-a5cb-39b5b2f8e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:31.831370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3d47e57a-e3b6-4f07-a5cb-39b5b2f8e819 None None] MFA Rules not processed for user `aa7e39ed76504159bebf85b7ad4b7122`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:31.832540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3d47e57a-e3b6-4f07-a5cb-39b5b2f8e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:31.839433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1208/2390] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:33.049797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561fe98-6ae3-4b4d-80a5-780ef92279b7 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:33.050489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561fe98-6ae3-4b4d-80a5-780ef92279b7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:33.050489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561fe98-6ae3-4b4d-80a5-780ef92279b7 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:33.051828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1183/2391] 10.222.0.42 () {54 vars in 961 bytes} [Fri Sep 9 13:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:27:33.057029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265e2c-c253-482b-8580-c0d87f78a5d0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:33.057514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265e2c-c253-482b-8580-c0d87f78a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:33.057612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265e2c-c253-482b-8580-c0d87f78a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:33.079086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4c265e2c-c253-482b-8580-c0d87f78a5d0 None None] MFA Rules not processed for user `9f10025eaa664fbc8fff276dfd1dafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:33.080300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4c265e2c-c253-482b-8580-c0d87f78a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:33.145754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1209/2392] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Sep 9 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:27:33.155199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561fe98-6ae3-4b4d-80a5-780ef92279b7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:33.169478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561fe98-6ae3-4b4d-80a5-780ef92279b7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:33.174503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:33.175102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:33.175385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:33.175670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:33.177391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:33.189607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:33.191237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d3a6-853f-478c-a95c-b286a0ebb171 service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:33.201224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1184/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:27:33.729921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:33.730222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:33.730687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:33.751668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] MFA Rules not processed for user `6a7e5dcbc3094702935241be3a9c811f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:33.752909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:33.816097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1210/2394] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:34.732445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94be8-25ba-425a-a6d5-1cf8c1618d71 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:34.732976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94be8-25ba-425a-a6d5-1cf8c1618d71 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:34.732976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf94be8-25ba-425a-a6d5-1cf8c1618d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:34.755678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-abf94be8-25ba-425a-a6d5-1cf8c1618d71 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:27:34.757856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-abf94be8-25ba-425a-a6d5-1cf8c1618d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:27:34.769279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1185/2395] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:27:34.784684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:27:34.798349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c62678-7e68-4702-aa89-1381c72039cf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:27:34.829377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:27:34.830364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:27:34.830845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:27:34.831300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:27:34.864035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:27:34.875582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:27:34.896896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1211/2396] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:27:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:27:44.748643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=9 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:44.882269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=63 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:06.049805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:06.050447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:06.050447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:06.097237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:06.099650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:06.119655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1186/2397] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:28:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:28:06.137108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:06.151480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c197-1590-40da-b372-c469a15e6a1f service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:06.162421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:06.164057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:06.164546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:06.165023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:06.176143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:06.177746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:06.188289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1212/2398] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:28:06.440334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:06.442955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:06.754557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea557e2-e415-4a5c-8c39-744cf93dae82 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:06.759974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:06.760902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:06.761364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:06.761951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] PATH_INFO: `/v3/users/340b906fc22b4ad38e1fddc26f7750df` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:06.763962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=340b906fc22b4ad38e1fddc26f7750df)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:06.766054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:06.845480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340b906fc22b4ad38e1fddc26f7750df'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:06.846275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340b906fc22b4ad38e1fddc26f7750df'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:06.847173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340b906fc22b4ad38e1fddc26f7750df'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:06.856756 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340b906fc22b4ad38e1fddc26f7750df'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:06.880199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340b906fc22b4ad38e1fddc26f7750df'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:06.899321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1187/2399] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:28:06 2022] DELETE /identity/v3/users/340b906fc22b4ad38e1fddc26f7750df => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:28:07.330571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:07.347625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816d11-72c7-4a01-a066-dbec9dc05c69 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:07.492688 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:07.496181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:07.497453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:07.498059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] PATH_INFO: `/v3/projects/1db6f9dd59e849ccaa59c7896b476073` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:07.499714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db6f9dd59e849ccaa59c7896b476073)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:07.502025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:07.579001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db6f9dd59e849ccaa59c7896b476073', 'request_id': 'req-6f964904-0927-46e5-b0ea-95e25ff58ab6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.588339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db6f9dd59e849ccaa59c7896b476073', 'request_id': 'req-6f964904-0927-46e5-b0ea-95e25ff58ab6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.594948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db6f9dd59e849ccaa59c7896b476073', 'request_id': 'req-6f964904-0927-46e5-b0ea-95e25ff58ab6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.616921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] The token cache is being invalidate because project 1db6f9dd59e849ccaa59c7896b476073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:28:07.617362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.618094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.620756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1213/2400] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:28:07 2022] DELETE /identity/v3/projects/1db6f9dd59e849ccaa59c7896b476073 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:28:07.625219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:07.626678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:07.649787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba63cf0-79aa-4cab-bb8f-5df9a79cf51c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:07.801683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:07.802621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:07.802912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:07.803191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] PATH_INFO: `/v3/users/f8fb2911923d4117b6358ef0d41b89bd` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:07.804375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8fb2911923d4117b6358ef0d41b89bd)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:07.806391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:07.836821 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:07.892454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fb2911923d4117b6358ef0d41b89bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.893218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fb2911923d4117b6358ef0d41b89bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.893867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fb2911923d4117b6358ef0d41b89bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.902527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fb2911923d4117b6358ef0d41b89bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.915995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fb2911923d4117b6358ef0d41b89bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:07.932568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1188/2401] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:28:07 2022] DELETE /identity/v3/users/f8fb2911923d4117b6358ef0d41b89bd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:28:08.248243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:08.249336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:08.277106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f964904-0927-46e5-b0ea-95e25ff58ab6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:08.344257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:08.345732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:08.346020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:08.346325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] PATH_INFO: `/v3/projects/3485448dab16496789e73927f4f667b7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:08.347620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3485448dab16496789e73927f4f667b7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:08.350043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:08.376178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:08.411750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3485448dab16496789e73927f4f667b7', 'request_id': 'req-0dff2088-9d19-4e2d-897d-ead9015f0bc9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:08.420721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3485448dab16496789e73927f4f667b7', 'request_id': 'req-0dff2088-9d19-4e2d-897d-ead9015f0bc9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:08.427282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3485448dab16496789e73927f4f667b7', 'request_id': 'req-0dff2088-9d19-4e2d-897d-ead9015f0bc9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:08.443805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] The token cache is being invalidate because project 3485448dab16496789e73927f4f667b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:28:08.444144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:08.445540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0dff2088-9d19-4e2d-897d-ead9015f0bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:28:08.447521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1214/2402] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:28:08 2022] DELETE /identity/v3/projects/3485448dab16496789e73927f4f667b7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:28:13.275427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:13.276834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:13.339175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b85b6-537c-4fff-9982-72405b720667 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:13.391107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:13.391713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:13.391987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:13.392254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:13.394101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:13.464256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:13.466328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c6025-fe00-4212-8c82-7e6ebe0909bd service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:13.470490 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:13.490620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1189/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:28:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:28:18.440373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:23.482637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:24.891448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:24.892005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:24.892005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:24.893474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1215/2404] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:28:24.899924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5300c2-f3dc-44f1-af29-1eeb280b5dae None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:24.900378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5300c2-f3dc-44f1-af29-1eeb280b5dae None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:24.900478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5300c2-f3dc-44f1-af29-1eeb280b5dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:24.922951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0a5300c2-f3dc-44f1-af29-1eeb280b5dae None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:24.924357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0a5300c2-f3dc-44f1-af29-1eeb280b5dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:24.994268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1190/2405] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:28:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:28:25.008731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:25.010456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:25.072595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f4f4-c74a-4873-86c0-440a48aa7d08 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:25.076832 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:25.077435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.077716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.077989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.087879 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:25.089292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce314e09-f0fb-474f-8825-5aa5e5a65997 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:25.100153 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1216/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:28:25.170181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.170515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.170729 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] PATH_INFO: `/` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.172074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1191/2407] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:28:25.176915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863aa5-b085-4167-afdc-4369e7563e9a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.177199 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863aa5-b085-4167-afdc-4369e7563e9a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.177471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb863aa5-b085-4167-afdc-4369e7563e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.196719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cb863aa5-b085-4167-afdc-4369e7563e9a None None] MFA Rules not processed for user `f589a94d7e714f01bdf29794f8e4e5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:25.197906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cb863aa5-b085-4167-afdc-4369e7563e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:25.204929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1217/2408] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:28:25.217375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:25.218927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:25.232306 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7cab-0cdb-42c3-b278-67b202b21269 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:25.235599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:25.236184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.236463 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.236733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.243707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:25.245112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b7b98-be7d-41e8-b49b-62f45740588a service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:25.253023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1192/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:28:25.335090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b305e-9a13-436f-8d5c-4d0de5e28fa4 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.335373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b305e-9a13-436f-8d5c-4d0de5e28fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.335643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b305e-9a13-436f-8d5c-4d0de5e28fa4 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.336987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1218/2410] 10.222.0.42 () {54 vars in 921 bytes} [Fri Sep 9 13:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 13:28:25.343232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62da7c0-40b7-4e47-81b9-f41b588ac59a None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.343519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62da7c0-40b7-4e47-81b9-f41b588ac59a None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.343806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62da7c0-40b7-4e47-81b9-f41b588ac59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.364218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e62da7c0-40b7-4e47-81b9-f41b588ac59a None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:25.365435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e62da7c0-40b7-4e47-81b9-f41b588ac59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:25.374568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1193/2411] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Sep 9 13:28:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:28:25.384990 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b305e-9a13-436f-8d5c-4d0de5e28fa4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:25.396985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b305e-9a13-436f-8d5c-4d0de5e28fa4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:25.400492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:25.401069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:25.401343 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:25.401613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:25.412393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:25.413791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:25.424467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1219/2412] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:28:29.464126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d2f3-0974-46c5-9153-f75d8d5e9500 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:29.464615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d2f3-0974-46c5-9153-f75d8d5e9500 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:29.464615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d2f3-0974-46c5-9153-f75d8d5e9500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:29.484244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d9b5d2f3-0974-46c5-9153-f75d8d5e9500 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:29.485493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d9b5d2f3-0974-46c5-9153-f75d8d5e9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:29.539776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1194/2413] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:28:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:28:29.561552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:29.562964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:29.639935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96d2b-311d-464b-a50a-5dc7205f7b63 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:29.644952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:29.645590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:29.645868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:29.646138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:29.654687 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:29.656304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:29.664457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1220/2414] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:28:39.533016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=65 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:39.661239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=67 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:28:59.537862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:59.538371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:59.538476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:59.557420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:28:59.558630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:28:59.566482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1195/2415] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:28:59.579393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:28:59.590863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3a348-089d-489f-afd3-2423e04a81cb service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:28:59.596164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:28:59.596802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:28:59.597098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:28:59.597368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:28:59.605937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:28:59.607562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:28:59.616332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1221/2416] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:28:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:29:09.552747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:09.613137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:43.216935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:29:43.218366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:29:43.273998 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2da0e-5862-444b-a931-56eb17825bee None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:29:43.277549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:29:43.278136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:29:43.278443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:29:43.278710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:29:43.280393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:29:43.293374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:29:43.294820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:29:43.306058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1196/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:29:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:29:44.383117 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:29:44.384530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:29:44.396811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5d61c-587a-4265-9589-0453f0b54ee8 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:29:44.400364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:29:44.400951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:29:44.401221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:29:44.401501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:29:44.403168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:29:44.460644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:29:44.462069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:29:44.471381 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1222/2418] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:29:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:29:53.300779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=26 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:54.467030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=28 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:02.539953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:30:02.541437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:02.552948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d337f-eb72-4d4d-9417-8bb9169e72af service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:30:02.556681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:30:02.557307 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:02.557585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:02.557853 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:02.559568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:02.568913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:30:02.570778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935b429-b6ce-44d2-93cd-422849f30322 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:30:02.579011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1197/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:30:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:30:12.575385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=6 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:30.829700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:30:30.831246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:30.847088 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb736-d4f9-424b-88c4-1b12ddba5862 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:30:30.852514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:30:30.853116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:30.853396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:30.854176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:30.856211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:30.912782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:30:30.914410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:30:30.924184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1223/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:30:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:30:36.190158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3fad-ed9c-4d77-b059-b8bce27ad260 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:36.190733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3fad-ed9c-4d77-b059-b8bce27ad260 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:36.190733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a3fad-ed9c-4d77-b059-b8bce27ad260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:36.213410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c08a3fad-ed9c-4d77-b059-b8bce27ad260 None None] MFA Rules not processed for user `6a7e5dcbc3094702935241be3a9c811f`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:30:36.215010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c08a3fad-ed9c-4d77-b059-b8bce27ad260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:36.277743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1198/2421] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:30:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:30:40.920015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=28 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:41.282718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:30:41.295898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ddfe-21b3-4ba2-ace5-5d0a44b26a3a service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:30:41.301729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:30:41.302530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:41.302815 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:41.303093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:41.304852 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:41.323431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:30:41.325738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:30:41.339147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1224/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:30:46.269628 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=25 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:49.523823 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:49.524386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:49.524386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:49.543527 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] MFA Rules not processed for user `91786707d68f4a18a35031db85066d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:30:49.544717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:49.551430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1199/2423] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:30:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:30:49.857791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:30:49.867142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb521a74-9630-4533-8e48-f20abd4034bf service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:30:49.871406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:30:49.871999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:49.872282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:49.872558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:49.874318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:49.883630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:30:49.885042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:30:49.893730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1225/2424] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:30:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:30:51.227468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:30:51.228907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:51.303257 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874da2d7-176b-40a6-bed2-d3ee08760fe6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:30:51.308979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:30:51.309578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:30:51.309854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:30:51.310120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:30:51.311835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:30:51.323849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:30:51.325420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fce45c-0bd7-42aa-a290-05a2be3baa6a service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:30:51.335397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1200/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:30:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:30:59.890145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=12 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:31:01.186432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:31:01.201004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238ffa5-a336-42cc-bf45-7699d98b1bb6 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:31:01.206522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:31:01.207121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:31:01.207396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:31:01.207661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:31:01.209378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:31:01.222333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:31:01.223902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:31:01.235743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1226/2426] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:31:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:31:01.331083 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=35 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:31:11.229860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:31:29.112917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:31:29.113652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:31:29.113959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:31:29.133108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] MFA Rules not processed for user `077cb54664e6457dbd31dae1708e8639`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:31:29.134335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:31:29.141316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1201/2427] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:31:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:31:32.939385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:31:32.950931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b9a6d-ff20-458a-9489-cbfa03769330 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:31:32.957166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:31:32.957885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:31:32.958163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:31:32.958594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:31:32.960451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:31:32.974099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:31:32.975819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c40f-6ec1-48c8-960d-616a1b233937 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:31:32.986960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1227/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:31:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:31:39.128314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:31:42.982063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:05.031279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:05.040636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0b1fe-e4ee-4008-8434-1f76e058c674 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:05.044125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:05.044811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:05.045202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:05.045478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:05.047270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:05.058143 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:05.059588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:05.069664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1202/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:15.065704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=6 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:16.431074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:16.431623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:16.432056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:16.458024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:16.459403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:16.466783 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1228/2430] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:16.519690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:16.532766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dd64-566c-4411-91de-221930c979fd service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:16.538037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:16.538764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:16.539115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:16.539458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:16.548294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:16.549979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:16.559165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1203/2431] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:32:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:32:16.956016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:16.967342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259fb9b-7715-4a37-b21b-7374d6ba4bce None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:16.971386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:16.971995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:16.972267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:16.972531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:16.974404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:17.042238 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:17.043700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:17.054854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1229/2432] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:20.214743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:20.254543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46361346-c30a-4356-8444-2610f3305a66 service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:20.260777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:20.261539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:20.261948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:20.262311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:20.266786 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:20.310894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:20.313265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:20.330725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1204/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:23.649872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:23.651421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:23.730718 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dd012-9b7d-4057-8526-57e1ac271d83 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:23.736929 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:23.737562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:23.737839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:23.738113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] PATH_INFO: `/v3/users/aa7e39ed76504159bebf85b7ad4b7122` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:23.739286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7e39ed76504159bebf85b7ad4b7122)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:23.741206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:23.788611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7e39ed76504159bebf85b7ad4b7122'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:23.789279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7e39ed76504159bebf85b7ad4b7122'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:23.797342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7e39ed76504159bebf85b7ad4b7122'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:23.809821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7e39ed76504159bebf85b7ad4b7122'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:23.817095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7e39ed76504159bebf85b7ad4b7122'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:23.818598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:23.824814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1230/2434] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:32:23 2022] DELETE /identity/v3/users/aa7e39ed76504159bebf85b7ad4b7122 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:23.999697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:24.010565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c864240-70c1-49c0-9043-af8da452111f service placement] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:24.067835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:24.068392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:24.068670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:24.069051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] PATH_INFO: `/v3/projects/49a6109337a942c79584a0fa5219ca2d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:24.070053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a6109337a942c79584a0fa5219ca2d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:24.071986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:24.118503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a6109337a942c79584a0fa5219ca2d', 'request_id': 'req-1b102c0b-94ce-41a6-af17-634fa8c0cb30'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.124492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a6109337a942c79584a0fa5219ca2d', 'request_id': 'req-1b102c0b-94ce-41a6-af17-634fa8c0cb30'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.129968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a6109337a942c79584a0fa5219ca2d', 'request_id': 'req-1b102c0b-94ce-41a6-af17-634fa8c0cb30'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.143199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] The token cache is being invalidate because project 49a6109337a942c79584a0fa5219ca2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:32:24.143518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.144148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.145607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1205/2435] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:32:23 2022] DELETE /identity/v3/projects/49a6109337a942c79584a0fa5219ca2d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:24.149818 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:24.151605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:24.165753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea681-f2c7-498c-b756-12b6547fa9ec admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:24.223805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:24.224439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:24.224722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:24.224999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] PATH_INFO: `/v3/users/f9a751be3426471b9d5c2a0ee5d34ecf` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:24.226114 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a751be3426471b9d5c2a0ee5d34ecf)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:24.228067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:24.274402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a751be3426471b9d5c2a0ee5d34ecf'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.275055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a751be3426471b9d5c2a0ee5d34ecf'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.282896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a751be3426471b9d5c2a0ee5d34ecf'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.295021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a751be3426471b9d5c2a0ee5d34ecf'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.302119 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a751be3426471b9d5c2a0ee5d34ecf'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.308013 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1231/2436] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:32:24 2022] DELETE /identity/v3/users/f9a751be3426471b9d5c2a0ee5d34ecf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:24.479070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:24.488259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:24.505948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102c0b-94ce-41a6-af17-634fa8c0cb30 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:24.519464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:24.568975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:24.569603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:24.569886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:24.570153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] PATH_INFO: `/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:24.571322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fdb9c8859e4cd2a2592aa25afb875a)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:24.573279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:24.623379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fdb9c8859e4cd2a2592aa25afb875a', 'request_id': 'req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.630122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fdb9c8859e4cd2a2592aa25afb875a', 'request_id': 'req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.635990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fdb9c8859e4cd2a2592aa25afb875a', 'request_id': 'req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.650009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] The token cache is being invalidate because project 67fdb9c8859e4cd2a2592aa25afb875a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:32:24.650331 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.651026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:24.652636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1206/2437] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:32:24 2022] DELETE /identity/v3/projects/67fdb9c8859e4cd2a2592aa25afb875a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:28.352350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:28.353775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:28.415838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af7a8b-a1b1-482a-97db-a4d422fb80fb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:28.444758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:28.465027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:28.465593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:28.465870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:28.466137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:28.467920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:28.529697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:28.531599 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:28.541244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1232/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:31.625991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:31.627517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:31.706586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:31.708097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:31.723828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa21565-2326-43e9-8a81-7ad183dcf735 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:31.728592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:31.729255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:31.729529 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:31.729797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] PATH_INFO: `/v3/users/6a7e5dcbc3094702935241be3a9c811f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:31.731064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7e5dcbc3094702935241be3a9c811f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:31.733209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:31.749730 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a1987-a1c9-4ce5-a3db-18c9c6bc0b86 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:31.755350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:31.755970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:31.756237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:31.756504 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:31.758515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:31.772814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:31.774514 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:31.785482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1207/2439] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:31.788072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7e5dcbc3094702935241be3a9c811f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:31.788726 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7e5dcbc3094702935241be3a9c811f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:31.796602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7e5dcbc3094702935241be3a9c811f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:31.808861 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7e5dcbc3094702935241be3a9c811f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:31.820468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a61d0ac0-cf3c-414d-8079-0378c2fd7de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7e5dcbc3094702935241be3a9c811f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:31.826544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1233/2440] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:32:31 2022] DELETE /identity/v3/users/6a7e5dcbc3094702935241be3a9c811f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:32:31.999169 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.025600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691f1c-b72a-42a0-a84c-78a5a6c6c03e service placement] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.037907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:32.085533 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.086073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.086383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.086657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] PATH_INFO: `/v3/projects/1aa4ee2b38304cbaa21a1b93ee4e3f5e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.087768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa4ee2b38304cbaa21a1b93ee4e3f5e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.089662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.135470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa4ee2b38304cbaa21a1b93ee4e3f5e', 'request_id': 'req-b17a9eb9-fe7f-4021-b6a8-450232b195b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:32.142090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa4ee2b38304cbaa21a1b93ee4e3f5e', 'request_id': 'req-b17a9eb9-fe7f-4021-b6a8-450232b195b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:32.147716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa4ee2b38304cbaa21a1b93ee4e3f5e', 'request_id': 'req-b17a9eb9-fe7f-4021-b6a8-450232b195b8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:32.159979 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] The token cache is being invalidate because project 1aa4ee2b38304cbaa21a1b93ee4e3f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:32:32.160271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:32.160887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b17a9eb9-fe7f-4021-b6a8-450232b195b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:32.162449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1208/2441] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:32:31 2022] DELETE /identity/v3/projects/1aa4ee2b38304cbaa21a1b93ee4e3f5e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:32.168420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.168735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.169012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.228661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:32.229881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:32.248411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:32.290729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1234/2442] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:32.299172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.299456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.299731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.319509 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:32.320703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:32.329098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1209/2443] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:32.333226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.342935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd2dc9-ab0e-4674-9edd-2afe431f717a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.348797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.349398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.349681 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.349957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.350644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:32:32.350947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.352528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.364690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1235/2444] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:32:32.368894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.378484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cd652-8342-4818-b3cc-8ead862c1569 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.382994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.383574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.383849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.384115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.384731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.386641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.412648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1210/2445] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:32:32 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:32.416594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.427468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21145c0-f0ad-4a3b-ba3b-a90dc6a7dd89 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.482605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.483207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.483488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.483762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.485028 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.487212 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.508359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1236/2446] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:32:32 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:32.512426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.522629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38f2f7-5dda-4f14-b4e0-082245be0d81 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.527100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.527684 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.527962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.528233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.528867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.530471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.540727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1211/2447] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:32:32.544575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.555541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d3c48-618a-43d3-9a6d-e20a271a292d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.560474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.561073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.561356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.561632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.562305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.564812 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7066d00-25a3-42bf-b83f-ac7cdf453f51 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.575250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1237/2448] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:32:32.579475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.589448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fb8b-8675-424b-8417-f4d980e24006 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.594025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.594635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.594914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.595183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] PATH_INFO: `/v3/projects/0a04971184654639a7ffa070c3f12d1b/users/70e4a160e2c34f3cae3c9d234ffcd157/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.610156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a04971184654639a7ffa070c3f12d1b, user_id=70e4a160e2c34f3cae3c9d234ffcd157, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.613237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.626973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1212/2449] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:32:32 2022] PUT /identity/v3/projects/0a04971184654639a7ffa070c3f12d1b/users/70e4a160e2c34f3cae3c9d234ffcd157/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:32.637032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.637323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.637624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.665302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] MFA Rules not processed for user `70e4a160e2c34f3cae3c9d234ffcd157`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:32.666553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:32.735711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1238/2450] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:32.747157 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:32.748896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:32.799021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:32.855216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e954-4b7c-40ed-8e8a-015b399599d7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:32.861349 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:32.862196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:32.862528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:32.862790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:32.870348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:32.871927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe67ab-3b7f-4a12-9d11-a7368815b80a service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:32.880631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1213/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:33.074423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:33.095926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:33.137885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affd58-211e-40ff-81f0-298377bd4921 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:33.143141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:33.143769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.144042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.144309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] PATH_INFO: `/v3/users/70e4a160e2c34f3cae3c9d234ffcd157` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.145403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e4a160e2c34f3cae3c9d234ffcd157)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:33.147338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:33.197860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e4a160e2c34f3cae3c9d234ffcd157'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.198555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e4a160e2c34f3cae3c9d234ffcd157'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.206440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e4a160e2c34f3cae3c9d234ffcd157'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.218241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e4a160e2c34f3cae3c9d234ffcd157'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.226091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e4a160e2c34f3cae3c9d234ffcd157'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.231976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1239/2452] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:32:33 2022] DELETE /identity/v3/users/70e4a160e2c34f3cae3c9d234ffcd157 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:33.236503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.236792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.237336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.255803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:33.256994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:33.315268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1214/2453] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:33.324949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:33.326471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:33.382934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bfc1f-b606-43b2-9f63-0fe21c280e81 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:33.386598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:33.387195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.387475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.387751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.397248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:33.398630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ac899-4dd2-4aeb-9a2a-0e33b15a2302 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:33.408979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1240/2454] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:33.677464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:33.679110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:33.692817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb4d9d-98a5-41f1-aea7-162cce8842aa None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:33.697389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:33.698022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.698329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.698609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] PATH_INFO: `/v3/projects/0a04971184654639a7ffa070c3f12d1b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.699717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a04971184654639a7ffa070c3f12d1b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:33.701650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:33.748612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a04971184654639a7ffa070c3f12d1b', 'request_id': 'req-390eb8e7-a819-4849-88bd-73ce683860ea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.755253 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a04971184654639a7ffa070c3f12d1b', 'request_id': 'req-390eb8e7-a819-4849-88bd-73ce683860ea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.760954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a04971184654639a7ffa070c3f12d1b', 'request_id': 'req-390eb8e7-a819-4849-88bd-73ce683860ea'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.773525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] The token cache is being invalidate because project 0a04971184654639a7ffa070c3f12d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:32:33.773810 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.774451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-390eb8e7-a819-4849-88bd-73ce683860ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:32:33.775923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1215/2455] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:32:33 2022] DELETE /identity/v3/projects/0a04971184654639a7ffa070c3f12d1b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:33.781043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.781521 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.781713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.802626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:33.803826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:33.842506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:33.865611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1241/2456] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:33.873447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.873732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.873999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.893907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:33.895142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:33.902920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1216/2457] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:32:33.907903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:33.917437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed08bd-ef2f-4322-8950-3bf39fdb3904 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:33.922987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:33.923514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.923794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.924068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.924725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:32:33.925022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:33.926683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:33.938054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1242/2458] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:32:33.942236 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:33.951409 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ee5b0-e745-49a6-b82d-8fe3f1bb23f7 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:33.956189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:33.956785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:33.957067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:33.957345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:33.957983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:33.959923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:33.976026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:33.989742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1217/2459] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:32:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:33.993841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.003830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71f81-8aaa-4d9d-8638-e1b0515bafd0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.059213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.059820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.060101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.060380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.061004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.062964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.084085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1243/2460] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:32:33 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:34.087491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.098258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a80bb-7ee7-4624-8827-9eb17262836d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.102814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.103406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.103685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.103958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.104599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.106184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.116766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1218/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:32:34.120491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.130425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e1646-87ad-4bdb-8a53-bff415fe61a8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.135058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.135653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.135932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.136210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.136853 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.138459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d5e1-98e6-41fb-b977-f9f04da22b21 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.148955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1244/2462] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:32:34.152833 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.164362 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1928cc-3b65-471d-8c0f-266107225e14 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.168889 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.169525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.169798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.170066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] PATH_INFO: `/v3/projects/11a8280eb9564d30b8fe74170ac3a38b/users/960e8153d34a45e3aa753aa4d02e9f65/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.185967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a8280eb9564d30b8fe74170ac3a38b, user_id=960e8153d34a45e3aa753aa4d02e9f65, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.188565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.200753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1219/2463] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:32:34 2022] PUT /identity/v3/projects/11a8280eb9564d30b8fe74170ac3a38b/users/960e8153d34a45e3aa753aa4d02e9f65/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:32:34.212193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.212480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.212755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.241725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] MFA Rules not processed for user `960e8153d34a45e3aa753aa4d02e9f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:34.242976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:34.305292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1245/2464] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:32:34.309696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.371985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52f8-39a1-48e1-9167-b151e0d9fa22 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.376690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.377282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.377557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.377822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.378478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.380354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.407335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1220/2465] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:32:34 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:34.411572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.422539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a871b3a-b563-489d-9a6a-dba9ba8f54b7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.455554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:34.479371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.479977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.480255 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.480542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.481164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.483109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.506315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1246/2466] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:32:34 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:32:34.508534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.519373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8001-0a7f-4d54-a78f-90588309aa5b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.523961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.524551 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.524829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.525100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.525734 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.527351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.538225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1221/2467] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:32:34.542429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.552610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a427ba-2ab3-4927-b027-8bae36871aec admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.557195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.557833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.558109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.558409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] PATH_INFO: `/v3/projects/acb99e46529541548fdeff6c86a2399d/users/483692fefa484e97874a92e8f530bfdd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.572619 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb99e46529541548fdeff6c86a2399d, user_id=483692fefa484e97874a92e8f530bfdd, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.575290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.588247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1247/2468] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:32:34 2022] PUT /identity/v3/projects/acb99e46529541548fdeff6c86a2399d/users/483692fefa484e97874a92e8f530bfdd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:34.592162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.602520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8d4-9698-4ef6-8d1a-90eafdd802d0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.658668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.659265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.659543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.659846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.660507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.662095 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b1b0e-253a-4c8b-af9d-1a14303d655c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.672553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1222/2469] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:32:34.676721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.686987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273531d-e925-4d0c-97c2-350ae1c9edff admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.693151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.693802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.694080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.694400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] PATH_INFO: `/v3/projects/acb99e46529541548fdeff6c86a2399d/users/483692fefa484e97874a92e8f530bfdd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.696300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb99e46529541548fdeff6c86a2399d, user_id=483692fefa484e97874a92e8f530bfdd, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.698951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.709863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1248/2470] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:32:34 2022] PUT /identity/v3/projects/acb99e46529541548fdeff6c86a2399d/users/483692fefa484e97874a92e8f530bfdd/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:32:34.720061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.720530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.720647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.748052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] MFA Rules not processed for user `483692fefa484e97874a92e8f530bfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:32:34.749252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:34.768238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:34.817438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1223/2471] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:32:34.829481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.831192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:32:34.888538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f53ef6-fb5b-4c94-8fac-4a855d58fdb4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:34.892709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:34.893307 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:34.893590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:34.893864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:34.902735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:34.904156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:34.913600 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1249/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:34.987418 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:32:34.996852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c06c-6c09-44bc-9a10-f0235e9d71e4 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:32:35.001194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:32:35.001787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:32:35.002065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:32:35.002376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:32:35.058087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:32:35.059538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab89e3-003d-4b01-8227-25b265764f24 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:32:35.068975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1224/2473] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:32:44.910024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:32:45.065057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=48 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:05.381430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:05.441742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577989f-8378-47ee-91fd-0d6ad13dfa45 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:05.446556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:05.447174 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:05.447451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:05.447721 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] PATH_INFO: `/v3/users/960e8153d34a45e3aa753aa4d02e9f65` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:05.448819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=960e8153d34a45e3aa753aa4d02e9f65)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:05.450757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:05.495678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960e8153d34a45e3aa753aa4d02e9f65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:05.496320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960e8153d34a45e3aa753aa4d02e9f65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:05.503272 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960e8153d34a45e3aa753aa4d02e9f65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:05.515286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960e8153d34a45e3aa753aa4d02e9f65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:05.522378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960e8153d34a45e3aa753aa4d02e9f65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:05.527984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1250/2474] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:05 2022] DELETE /identity/v3/users/960e8153d34a45e3aa753aa4d02e9f65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:05.532630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:05.533119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:05.533223 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:05.552966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:05.554153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:05.611066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1225/2475] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:05.621373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:05.622880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:05.703716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649981dc-6ba4-4708-8a48-8e12c071b94c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:05.708645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:05.708964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:05.709294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:05.709768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:05.719737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:05.721217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:05.732082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1251/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:06.003064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.004543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:06.016394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6282e1-67bd-4119-8f95-66be8e7789e2 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.021906 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.022583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.022857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.023124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] PATH_INFO: `/v3/projects/11a8280eb9564d30b8fe74170ac3a38b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.026276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a8280eb9564d30b8fe74170ac3a38b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.026276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.075612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a8280eb9564d30b8fe74170ac3a38b', 'request_id': 'req-35148f2e-c1b3-4ffd-85ed-d2b816af0224'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.081806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a8280eb9564d30b8fe74170ac3a38b', 'request_id': 'req-35148f2e-c1b3-4ffd-85ed-d2b816af0224'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.087933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a8280eb9564d30b8fe74170ac3a38b', 'request_id': 'req-35148f2e-c1b3-4ffd-85ed-d2b816af0224'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.100099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] The token cache is being invalidate because project 11a8280eb9564d30b8fe74170ac3a38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:06.100391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.101024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.102534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1226/2477] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:06 2022] DELETE /identity/v3/projects/11a8280eb9564d30b8fe74170ac3a38b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:06.106495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.111458 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:06.118227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a484a8-27fb-4929-b3b2-e188202470dd service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.173497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.174115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.174422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.174697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] PATH_INFO: `/v3/users/483692fefa484e97874a92e8f530bfdd` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.175826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=483692fefa484e97874a92e8f530bfdd)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.178190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.225807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483692fefa484e97874a92e8f530bfdd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.226481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483692fefa484e97874a92e8f530bfdd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.234129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483692fefa484e97874a92e8f530bfdd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.246132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483692fefa484e97874a92e8f530bfdd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.253240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6f0f3fa0-a250-41d3-926c-79d2b57d68fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483692fefa484e97874a92e8f530bfdd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.259697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1252/2478] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:06 2022] DELETE /identity/v3/users/483692fefa484e97874a92e8f530bfdd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:06.527812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.529327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:06.542480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35148f2e-c1b3-4ffd-85ed-d2b816af0224 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.598410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.599043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.599327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.599601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] PATH_INFO: `/v3/projects/acb99e46529541548fdeff6c86a2399d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.600720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb99e46529541548fdeff6c86a2399d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.602761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.633672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:06.650425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb99e46529541548fdeff6c86a2399d', 'request_id': 'req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.656457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb99e46529541548fdeff6c86a2399d', 'request_id': 'req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.662269 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb99e46529541548fdeff6c86a2399d', 'request_id': 'req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.673948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] The token cache is being invalidate because project acb99e46529541548fdeff6c86a2399d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:06.674250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.674869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-76ba1e4b-b57e-4243-9a1b-471c92cba0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:06.676874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1227/2479] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:06 2022] DELETE /identity/v3/projects/acb99e46529541548fdeff6c86a2399d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:06.682070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.682548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.682548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.703580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:06.704795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:06.763342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1253/2480] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:33:06.771396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.771678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.771954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.791581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:06.792780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:06.800773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1228/2481] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:06.805591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.815166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040afe8-16ed-47f3-8758-79b107b1c129 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.820634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.821234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.821508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.821779 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.822470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:33:06.822770 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.824351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.836422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1254/2482] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:33:06.840732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.850548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d57a-b564-46dc-b6db-0fb11760b53d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.855385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.855920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.856201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.856473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.857099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.859037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.886165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1229/2483] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:06 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:06.890300 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:06.900430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb530431-b205-4a4c-8835-2f2e13990f99 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:06.905036 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:06.959612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:06.960221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:06.960504 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:06.960785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:06.961428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:06.963366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:06.985686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1255/2484] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:06 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:06.990735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.000989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40825cc-18c0-4adc-8ea0-d860bacf265c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.006334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.006927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.007205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.007478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.008115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.009782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.020330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1230/2485] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:07.024243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.033998 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d477-ea20-4bb7-bdf9-b381f2aae58a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.038942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.039525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.039803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.040074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.040704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.042308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad807804-e7a6-4e04-bbf9-b0a531f1090f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.055423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1256/2486] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:07.059426 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.069845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b483-9b59-49b3-9250-732bab69dc6e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.074408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.075041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.075319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.075596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] PATH_INFO: `/v3/projects/31a42a15b25d4bbfb8b3aaed2175b6d1/users/ecb831d92d1b4f9f87643c20cefce406/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.090337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a42a15b25d4bbfb8b3aaed2175b6d1, user_id=ecb831d92d1b4f9f87643c20cefce406, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.092970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.105579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1231/2487] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:07 2022] PUT /identity/v3/projects/31a42a15b25d4bbfb8b3aaed2175b6d1/users/ecb831d92d1b4f9f87643c20cefce406/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:07.116658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.116949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.117224 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.145304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] MFA Rules not processed for user `ecb831d92d1b4f9f87643c20cefce406`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:07.146553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:07.212316 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1257/2488] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:07.217139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.277769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c863f8-4543-4aa1-9f65-11fa021d0654 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.282371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.282966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.283248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.283524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.284153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.286068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.312079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1232/2489] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:07 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:07.316160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.327356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dde5e-236c-4ee9-917d-a78e7c7677f2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.382882 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.383414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.383690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.383961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.384591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.386549 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.407236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1258/2490] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:07 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:07.411812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.422311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90b6e-a752-4c39-805c-270bae9cb407 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.427673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.428266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.428546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.428819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.429453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.431084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.445586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1233/2491] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:07.446954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.456993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb74d-b9ed-4555-a7e0-ff00a90d285a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.461719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.462405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.462693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.462964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] PATH_INFO: `/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33/users/dbbbc518a05f45cab9bea71afc51e807/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.465253 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:07.480069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e071b5c2ae64dcfa30e3a44a1011f33, user_id=dbbbc518a05f45cab9bea71afc51e807, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.482769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.497178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1259/2492] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:07 2022] PUT /identity/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33/users/dbbbc518a05f45cab9bea71afc51e807/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:07.501166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.512064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a76813-3984-4665-8fef-264feafe15e7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.533240 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:07.576736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.577427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.577625 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.577897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.578583 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.580203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab1301-941c-4004-8975-d15d6b669f4f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.590917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1234/2493] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:33:07.595241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.606725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29c4ed-8349-4cc7-883c-2fc81e14486d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.611399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.612072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.612350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.612624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] PATH_INFO: `/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33/users/dbbbc518a05f45cab9bea71afc51e807/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.615261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e071b5c2ae64dcfa30e3a44a1011f33, user_id=dbbbc518a05f45cab9bea71afc51e807, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.617936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.629267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1260/2494] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:07 2022] PUT /identity/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33/users/dbbbc518a05f45cab9bea71afc51e807/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:07.641192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.641476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.641819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.673891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] MFA Rules not processed for user `dbbbc518a05f45cab9bea71afc51e807`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:07.675397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:07.748799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1235/2495] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:07.760928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.762795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:07.848415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c2a0-d77a-4cd3-9cf6-7ab4e2d4e1b5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.852429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.853035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.853313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.853587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:07.863066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:07.865179 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c6897-6544-486f-9e6b-72e7c6810f73 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:07.874805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1261/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:07.953374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:07.963958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fae26a-85cd-4b18-9e7d-d332caab9f29 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:07.967570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:07.968167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:07.968446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:07.968761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:08.024618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:08.026047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:08.034785 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1236/2497] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:09.981962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:09.982537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:09.982537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:10.012791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:10.013996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:10.069808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1262/2498] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:33:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:10.082310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:10.084526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:10.131220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:10.154584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96ecf-4a6c-431f-80a6-3b5e04dd1092 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:10.159601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:10.160208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:10.161098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:10.161431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:10.172367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:10.174079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869f961-a823-430f-b861-fa76aa1a7711 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:10.184793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1237/2499] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:33:10.766420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:10.820420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:10.836837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4c52d-41ed-4daf-9432-b080bab21e49 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:10.842489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:10.843107 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:10.843386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:10.843657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] PATH_INFO: `/v3/users/ecb831d92d1b4f9f87643c20cefce406` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:10.844827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb831d92d1b4f9f87643c20cefce406)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:10.847004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:10.909328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb831d92d1b4f9f87643c20cefce406'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:10.909903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb831d92d1b4f9f87643c20cefce406'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:10.920123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb831d92d1b4f9f87643c20cefce406'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:10.935432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb831d92d1b4f9f87643c20cefce406'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:10.943573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb831d92d1b4f9f87643c20cefce406'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:10.950177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1263/2500] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:10 2022] DELETE /identity/v3/users/ecb831d92d1b4f9f87643c20cefce406 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:10.954563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:10.954950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:10.955323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:10.976085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:10.977374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:11.048595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1238/2501] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:11.054934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:11.056490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:11.120606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffe001-6d7d-444d-8551-4c8cc5d4c7e2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:11.124714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:11.125311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:11.125660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:11.125999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:11.136394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:11.137991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:11.149650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1264/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:11.608282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:11.609926 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:11.630542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49175c-0712-4d60-b66a-3ac938fba312 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:11.635872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:11.636525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:11.636802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:11.637076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] PATH_INFO: `/v3/projects/31a42a15b25d4bbfb8b3aaed2175b6d1` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:11.638348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a42a15b25d4bbfb8b3aaed2175b6d1)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:11.640403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:11.700808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a42a15b25d4bbfb8b3aaed2175b6d1', 'request_id': 'req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.708375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a42a15b25d4bbfb8b3aaed2175b6d1', 'request_id': 'req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.715285 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a42a15b25d4bbfb8b3aaed2175b6d1', 'request_id': 'req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.729828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] The token cache is being invalidate because project 31a42a15b25d4bbfb8b3aaed2175b6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:11.730116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.730781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.732272 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1239/2503] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:11 2022] DELETE /identity/v3/projects/31a42a15b25d4bbfb8b3aaed2175b6d1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:11.736395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:11.747501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b4b7-9a22-4d0f-bb34-2c2af64cf2af service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:11.810668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:11.811452 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:11.812247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:11.812372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] PATH_INFO: `/v3/users/dbbbc518a05f45cab9bea71afc51e807` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:11.813430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbbc518a05f45cab9bea71afc51e807)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:11.815531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:11.837737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:11.907896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbbc518a05f45cab9bea71afc51e807'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.908746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbbc518a05f45cab9bea71afc51e807'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.918890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbbc518a05f45cab9bea71afc51e807'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.934633 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbbc518a05f45cab9bea71afc51e807'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.945165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9e500133-40e3-4a45-ae37-e85ce101f55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbbc518a05f45cab9bea71afc51e807'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:11.959592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1265/2504] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:11 2022] DELETE /identity/v3/users/dbbbc518a05f45cab9bea71afc51e807 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:12.267021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.268465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:12.296284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71289f-64b2-40aa-86c5-7cdb31bba8dd admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.357606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:12.366522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.367601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.368431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.368970 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] PATH_INFO: `/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.370453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e071b5c2ae64dcfa30e3a44a1011f33)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.372428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.425213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e071b5c2ae64dcfa30e3a44a1011f33', 'request_id': 'req-9311a157-ad5e-4857-a92e-5623b7d2dee2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:12.432571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e071b5c2ae64dcfa30e3a44a1011f33', 'request_id': 'req-9311a157-ad5e-4857-a92e-5623b7d2dee2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:12.439018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e071b5c2ae64dcfa30e3a44a1011f33', 'request_id': 'req-9311a157-ad5e-4857-a92e-5623b7d2dee2'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:12.455586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] The token cache is being invalidate because project 2e071b5c2ae64dcfa30e3a44a1011f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:12.455972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:12.456709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9311a157-ad5e-4857-a92e-5623b7d2dee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:12.459273 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1240/2505] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:12 2022] DELETE /identity/v3/projects/2e071b5c2ae64dcfa30e3a44a1011f33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:12.463917 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.464479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.464479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.486180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:12.487750 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:12.553436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1266/2506] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:12.561075 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.561450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.561791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.587505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:12.588865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:12.597212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1241/2507] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:12.601605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.611554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8063eb0-a5bb-4b27-8361-615581f80ac7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.617164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.617774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.618052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.618413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.619323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:33:12.619732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.621559 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.637717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1267/2508] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:33:12.641918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.654659 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688a111-1e6d-4868-8c6b-6088274c831e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.663822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.664410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.664692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.665151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.665607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.669134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.704555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1242/2509] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:12 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:33:12.709096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.727154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521fb5b-bca2-475d-b44d-93fa29589367 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.797787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.798563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.798869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.799159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.799813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.801866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.834421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1268/2510] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:12 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:12.836535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.851210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdd86b-f50d-4498-8571-e860072781b2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.856600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.857208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.857484 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.857751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.858448 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.860088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.872740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1243/2511] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:12.876955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.887928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd293-2895-4a10-aeb8-4ad5dc454d71 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.892867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.893490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.893774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.894052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.894920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.897055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3eddd-937a-4b65-a00a-edb82a3d7ca7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.898424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:12.910254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1269/2512] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:12.914909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:12.927318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22625b4c-31f3-4e83-bd65-5322cb7bf1ac admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:12.932759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:12.934930 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.935298 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.935651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] PATH_INFO: `/v3/projects/492b8156bc9247ed8d2e8ec94610bf10/users/e4d4d17a7ce240f681710f0de43ac69f/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:12.954153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=492b8156bc9247ed8d2e8ec94610bf10, user_id=e4d4d17a7ce240f681710f0de43ac69f, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:12.957059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:12.974681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1244/2513] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:12 2022] PUT /identity/v3/projects/492b8156bc9247ed8d2e8ec94610bf10/users/e4d4d17a7ce240f681710f0de43ac69f/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:12.988915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:12.989629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:12.989964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.022317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] MFA Rules not processed for user `e4d4d17a7ce240f681710f0de43ac69f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:13.023626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:13.091563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1270/2514] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:13.095766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.167924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27991-b175-4d59-8897-c395409a1c0f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.172683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.173294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.173575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.173848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.174511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.177007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.209065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1245/2515] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:13 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:13.210344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.222982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500f35e-665f-41c6-8391-efafbd608777 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.287066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.287642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.288008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.288295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.288965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.290927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.319923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1271/2516] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:13 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:13.321312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.333237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13235984-223f-42a7-8cf4-7354188f068a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.338278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.338888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.339182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.339441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.340127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.341796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.344120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:13.355199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1246/2517] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:13.359367 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.370913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22d89-6814-45c6-b3e5-f3d2bfef4f00 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.375560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.376246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.376542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.376839 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] PATH_INFO: `/v3/projects/f13dc0119a3744a292daefba8b199bee/users/e7767fb6383c40c083866bddaaaf91de/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.393416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13dc0119a3744a292daefba8b199bee, user_id=e7767fb6383c40c083866bddaaaf91de, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.396257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.409492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1272/2518] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:13 2022] PUT /identity/v3/projects/f13dc0119a3744a292daefba8b199bee/users/e7767fb6383c40c083866bddaaaf91de/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:13.413589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.424171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefaf5-a893-4732-958b-539ba06698ce admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.497864 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.498607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.499535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.499535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.500364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.502062 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28e48-6573-47b5-ae00-e1202a586643 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.515317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1247/2519] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:13.520338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.535787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dec969-5ceb-4e53-8445-8dd20f7bd724 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.541656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.542382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.542661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.542934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] PATH_INFO: `/v3/projects/f13dc0119a3744a292daefba8b199bee/users/e7767fb6383c40c083866bddaaaf91de/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.545484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13dc0119a3744a292daefba8b199bee, user_id=e7767fb6383c40c083866bddaaaf91de, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.548417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.568069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1273/2520] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:13 2022] PUT /identity/v3/projects/f13dc0119a3744a292daefba8b199bee/users/e7767fb6383c40c083866bddaaaf91de/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:13.638780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.638982 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.639239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.670569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] MFA Rules not processed for user `e7767fb6383c40c083866bddaaaf91de`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:13.671798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:13.758812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1248/2521] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:13.768008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:13.776901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:13.824351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:13.856835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f50d1-c54a-411d-9eb1-453868c54a2d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:13.860605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:13.861215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:13.861498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:13.861772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:13.879044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:13.880609 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb02a62-9f41-48e1-9650-4c40114d8ee9 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:13.893285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1274/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:14.561545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:14.631063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521184b-cd89-4735-bfec-09f41f31b68f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:14.639681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:14.640138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:14.640539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:14.643732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] PATH_INFO: `/v3/users/e4d4d17a7ce240f681710f0de43ac69f` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:14.647082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d4d17a7ce240f681710f0de43ac69f)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:14.649328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:14.682743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:14.713068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d4d17a7ce240f681710f0de43ac69f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:14.713630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d4d17a7ce240f681710f0de43ac69f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:14.714528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d4d17a7ce240f681710f0de43ac69f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:14.722713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d4d17a7ce240f681710f0de43ac69f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:14.734880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d4d17a7ce240f681710f0de43ac69f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:14.748880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1249/2523] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:14 2022] DELETE /identity/v3/users/e4d4d17a7ce240f681710f0de43ac69f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:14.753668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:14.755186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:14.755792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:14.775982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:14.777223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:14.844538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1275/2524] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:14.855070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:14.856501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:14.923182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1bc0e-f955-41f0-a699-2cd2d10bf1aa admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:14.928150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:14.928399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:14.928658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:14.929017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:14.940266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:14.943127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:14.953074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1250/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:15.275892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:15.277370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:15.290152 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5430a-1850-44aa-a871-83625eaee98f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:15.295266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:15.295964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:15.296412 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:15.297366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] PATH_INFO: `/v3/projects/492b8156bc9247ed8d2e8ec94610bf10` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:15.298080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492b8156bc9247ed8d2e8ec94610bf10)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:15.299941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:15.356670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492b8156bc9247ed8d2e8ec94610bf10', 'request_id': 'req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.363096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492b8156bc9247ed8d2e8ec94610bf10', 'request_id': 'req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.369668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492b8156bc9247ed8d2e8ec94610bf10', 'request_id': 'req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.387571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] The token cache is being invalidate because project 492b8156bc9247ed8d2e8ec94610bf10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:15.387909 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.388497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.390397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1276/2526] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:15 2022] DELETE /identity/v3/projects/492b8156bc9247ed8d2e8ec94610bf10 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:15.394171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:15.405425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd87859-0c7e-4944-a578-f7f654da007b service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:15.471265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:15.472118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:15.472397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:15.472668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] PATH_INFO: `/v3/users/e7767fb6383c40c083866bddaaaf91de` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:15.473863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7767fb6383c40c083866bddaaaf91de)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:15.475814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:15.527310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:15.530108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7767fb6383c40c083866bddaaaf91de'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.530940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7767fb6383c40c083866bddaaaf91de'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.532048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7767fb6383c40c083866bddaaaf91de'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.541172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7767fb6383c40c083866bddaaaf91de'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.555402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-4885399d-95bd-452f-aa84-56b30953b16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7767fb6383c40c083866bddaaaf91de'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:15.570049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1251/2527] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:15 2022] DELETE /identity/v3/users/e7767fb6383c40c083866bddaaaf91de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:15.905502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:15.907038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:15.921711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bce9ce-d7b2-49d7-8f1a-e7e1cd4083b6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:15.997670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:15.998899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:15.999257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:15.999598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] PATH_INFO: `/v3/projects/f13dc0119a3744a292daefba8b199bee` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.000866 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13dc0119a3744a292daefba8b199bee)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.002884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.011802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:16.064471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13dc0119a3744a292daefba8b199bee', 'request_id': 'req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:16.070902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13dc0119a3744a292daefba8b199bee', 'request_id': 'req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:16.076985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13dc0119a3744a292daefba8b199bee', 'request_id': 'req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:16.091073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] The token cache is being invalidate because project f13dc0119a3744a292daefba8b199bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:16.091493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:16.092127 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c8e6bb5f-0c05-4fa7-a54c-6982a6a5e02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:16.093608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1277/2528] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:15 2022] DELETE /identity/v3/projects/f13dc0119a3744a292daefba8b199bee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:16.099045 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.099522 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.099619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.120175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:16.121408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:16.184799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1252/2529] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:16.192490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.192803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.193083 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.214258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:16.215446 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:16.223953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1278/2530] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:16.228205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.238722 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a79e90-67b4-4cad-b97e-405cdfea8b61 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.243004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.243612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.243891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.244189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.244929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:33:16.245170 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.246804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.263485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1253/2531] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:33:16.264201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.274416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95f56-dafa-4c88-a8a4-682f6cef3f47 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.281373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.282135 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.282547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.282943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.283712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.286491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.330383 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.339055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1279/2532] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:16 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:33:16.343623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcc448-a1b1-487e-b401-fe79d5d0f35b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.413358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.414077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.414588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.414966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.415699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.417991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.452141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1254/2533] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:16 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:16.456140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.467379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a175b-ede8-445c-8faf-cf8e5cc55342 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.472091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.472734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.473070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.473344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.474125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.475762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.486123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1280/2534] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:16.491243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.501220 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b8b2a-0e90-4980-9c77-3dc6d144fb16 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.507031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.507637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.507915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.508187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.508831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.510474 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c172e5-0c06-4ac3-acce-669473309dc0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.521619 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1255/2535] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:16.525944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.536946 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe01b-6cae-4adb-be7b-1c65b9e8d929 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.542176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.542948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.543327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.543670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] PATH_INFO: `/v3/projects/5776dba95a844c23b203ef334ae03614/users/16e0a6690c5f4cda93c1536721c63931/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.684751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5776dba95a844c23b203ef334ae03614, user_id=16e0a6690c5f4cda93c1536721c63931, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.688911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.703313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1281/2536] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:16 2022] PUT /identity/v3/projects/5776dba95a844c23b203ef334ae03614/users/16e0a6690c5f4cda93c1536721c63931/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:16.714052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.714375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.714652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.744218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] MFA Rules not processed for user `16e0a6690c5f4cda93c1536721c63931`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:16.745648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:16.759606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:16.818962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1256/2537] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:16.862475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:16.864582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:16.939502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985937c9-2b35-4479-acee-09127d0e7b1c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:16.944368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:16.944985 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:16.945262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:16.945539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:16.955213 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:16.956762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f967fdd-180e-4d90-a280-1cf4e2513b7d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:16.969895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1282/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:16.987817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:17.064064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcb959-7d94-4f1a-8275-8860119ff359 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:17.069715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:17.070452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.070736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.071011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] PATH_INFO: `/v3/users/16e0a6690c5f4cda93c1536721c63931` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:17.072165 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e0a6690c5f4cda93c1536721c63931)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:17.074559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:17.125300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e0a6690c5f4cda93c1536721c63931'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.126553 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e0a6690c5f4cda93c1536721c63931'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.127174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e0a6690c5f4cda93c1536721c63931'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.135256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e0a6690c5f4cda93c1536721c63931'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.151126 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e0a6690c5f4cda93c1536721c63931'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.167078 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1257/2539] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:33:16 2022] DELETE /identity/v3/users/16e0a6690c5f4cda93c1536721c63931 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:17.171766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663504f-f392-4630-9926-723ff15a898d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.172491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663504f-f392-4630-9926-723ff15a898d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.172491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663504f-f392-4630-9926-723ff15a898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:17.195273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e663504f-f392-4630-9926-723ff15a898d None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:17.196565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e663504f-f392-4630-9926-723ff15a898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:17.226093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:17.260499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1283/2540] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:33:17.271358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:17.272814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:17.315750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:17.337171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52151587-b66f-4538-b3bf-851bdb4ba3de admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:17.340974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:17.341717 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.342089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.342454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:17.352521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:17.353959 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e792c9a-1bac-4ef1-93df-e0d283f76798 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:17.363928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1258/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:17.707054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663504f-f392-4630-9926-723ff15a898d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:17.711017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e663504f-f392-4630-9926-723ff15a898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:17.732108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663504f-f392-4630-9926-723ff15a898d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:17.741299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:17.742474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.742914 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.743356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] PATH_INFO: `/v3/projects/5776dba95a844c23b203ef334ae03614` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:17.745164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5776dba95a844c23b203ef334ae03614)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:17.748873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:17.810380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5776dba95a844c23b203ef334ae03614', 'request_id': 'req-80fa2eb4-825f-4cdb-9211-ff547123d0b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.821012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5776dba95a844c23b203ef334ae03614', 'request_id': 'req-80fa2eb4-825f-4cdb-9211-ff547123d0b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.828806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5776dba95a844c23b203ef334ae03614', 'request_id': 'req-80fa2eb4-825f-4cdb-9211-ff547123d0b6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.850615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] The token cache is being invalidate because project 5776dba95a844c23b203ef334ae03614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:33:17.850979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.851758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-80fa2eb4-825f-4cdb-9211-ff547123d0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:33:17.853396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1284/2542] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:33:17 2022] DELETE /identity/v3/projects/5776dba95a844c23b203ef334ae03614 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:33:17.859122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.859436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.860560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:17.885854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:17.888347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:17.964508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1259/2543] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:17.975151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:17.976087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:17.976395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.008639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:18.011707 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:18.030880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1285/2544] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:18.037009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.069670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11876f6-cfb0-458d-a0f9-700a95902cca None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.074948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.075576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.075856 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.076184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.076824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:33:18.077909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.078757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.091610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1260/2545] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:33:18.096056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.106145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a68ec-66ba-46db-932b-89b4fbac4eba None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.111271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.112222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.112562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.112908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.113643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.116423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.147986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1286/2546] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:33:18 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:18.153117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.165381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eabb2e-ad48-4bcf-a9a4-618c1408b5e0 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.247193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.248492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.248924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.249401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.250043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.251999 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.280389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1261/2547] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:33:18 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:33:18.286336 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.297646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738d7b-b1e5-4ab4-8fdb-38e9c74a7cd1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.303876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.304848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.305239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.305601 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.306396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.308034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.324356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1287/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:33:18.326205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.339492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78701fe3-c29e-4f6a-9f10-87387a3fb260 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.344865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.345494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.345777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.346052 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.346767 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.349211 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca5010-c1ad-411f-ba93-423f01ebaa85 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.364702 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1262/2549] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:33:18.368602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.380908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5739-3a94-4a04-95d0-b1027a01d33b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.387435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.388424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.389046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.391090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] PATH_INFO: `/v3/projects/6eb8b7d8d3aa461c9972a40069dc2a59/users/8a3616c29bf3482cadb61dfe502aa64e/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.408162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb8b7d8d3aa461c9972a40069dc2a59, user_id=8a3616c29bf3482cadb61dfe502aa64e, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.414422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.439205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1288/2550] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:33:18 2022] PUT /identity/v3/projects/6eb8b7d8d3aa461c9972a40069dc2a59/users/8a3616c29bf3482cadb61dfe502aa64e/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:33:18.440886 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcbf7d-e09e-4383-8679-b1b7fa7286bb None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.441176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcbf7d-e09e-4383-8679-b1b7fa7286bb None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.441444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcbf7d-e09e-4383-8679-b1b7fa7286bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.463614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-f2dcbf7d-e09e-4383-8679-b1b7fa7286bb None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:18.464995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f2dcbf7d-e09e-4383-8679-b1b7fa7286bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:18.528706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:18.548814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1263/2551] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:18.559517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:18.562322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:18.628979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd857b-45d7-46d6-91be-086a1af07975 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:18.633397 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:18.634641 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:18.635165 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:18.635683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:18.645787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:18.648537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:18.650530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:18.666795 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1289/2552] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:19.540281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939209f7-6f87-4783-bc14-9a65e413710b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:19.540754 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939209f7-6f87-4783-bc14-9a65e413710b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:19.541248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939209f7-6f87-4783-bc14-9a65e413710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:19.574520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-939209f7-6f87-4783-bc14-9a65e413710b None None] MFA Rules not processed for user `8a3616c29bf3482cadb61dfe502aa64e`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:19.576087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-939209f7-6f87-4783-bc14-9a65e413710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:19.667412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1264/2553] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:19.675248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:19.676905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:19.752380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546904b-8029-4f59-ab70-d247fd030357 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:19.757266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:19.757880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:19.758158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:19.758461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:19.767725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:19.769292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:19.780222 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1290/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:21.204822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:21.205367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:21.205622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:21.255995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] MFA Rules not processed for user `8a3616c29bf3482cadb61dfe502aa64e`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:21.260291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:21.279510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1265/2555] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:22.743587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:22.745007 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:22.813038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52abce-150f-457a-94b0-bc830293758f service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:22.818625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:22.819237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:22.819517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:22.819791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:22.821561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:22.834071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:22.835670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:22.845494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1291/2556] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:31.239749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=42 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:31.611489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:31.612966 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:31.671022 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37b76f-e7b5-444c-bb51-ee4bde9c6673 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:31.674751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:31.675355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:31.675634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:31.675905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:31.678299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:31.751274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:31.752713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:31.763761 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1266/2557] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:31.828567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:31.838395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbdadf-a032-48e9-aa86-8d1ba7d4ec93 service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:31.842065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:31.842737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:31.843012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:31.843286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:31.845022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:31.854976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:31.856385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab95ea-5e3b-4605-9f8c-fe7686db29c0 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:31.864712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1292/2558] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:32.195027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:32.204460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40294e50-7493-4886-b226-6cf2931885ce service glance] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:32.208724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:32.209319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:32.209595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:32.209866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:32.211626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:32.225356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:32.226804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:32.237413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1267/2559] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:33:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:33:34.935625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097602-07af-4714-8eaf-40313032116c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:34.936129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097602-07af-4714-8eaf-40313032116c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:34.936382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097602-07af-4714-8eaf-40313032116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:34.957701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-aa097602-07af-4714-8eaf-40313032116c None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:34.959499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aa097602-07af-4714-8eaf-40313032116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:35.020009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1293/2560] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:33:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:35.032016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:35.033630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:35.114736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815d9a-14ae-4b4d-b267-59f821888585 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:35.120158 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d344a-05a3-487d-9862-965a480c003b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:35.120848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d344a-05a3-487d-9862-965a480c003b service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:35.121202 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d344a-05a3-487d-9862-965a480c003b service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:35.121552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d344a-05a3-487d-9862-965a480c003b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:35.130391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d344a-05a3-487d-9862-965a480c003b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:35.132057 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d344a-05a3-487d-9862-965a480c003b service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:35.140815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1268/2561] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 13:33:45.012172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:45.137778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:33:57.863957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34098e4-d02d-4926-b423-fe223922bd9a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:57.864535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34098e4-d02d-4926-b423-fe223922bd9a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:57.864713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34098e4-d02d-4926-b423-fe223922bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:57.884870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d34098e4-d02d-4926-b423-fe223922bd9a None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:33:57.886436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d34098e4-d02d-4926-b423-fe223922bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:33:57.893722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1294/2562] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:33:57.908988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d344a-05a3-487d-9862-965a480c003b service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:33:57.920827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d344a-05a3-487d-9862-965a480c003b service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:33:57.926141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:33:57.926799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:33:57.927097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:33:57.927424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:33:57.935632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:33:57.937195 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:33:57.945978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1269/2563] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:34:01.581301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:01.582034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:01.582034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:01.607374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] MFA Rules not processed for user `8a3616c29bf3482cadb61dfe502aa64e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:01.608850 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:01.622899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1295/2564] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:06.623376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:06.632745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed891dd-d126-4907-8b12-11b1e5aa8df9 service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:06.636311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:06.636901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:06.637186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:06.637458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:06.639173 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:06.651403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:06.652812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:06.663002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1270/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:34:09.707423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:09.709375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:09.724927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831fe8-d638-4dc2-a29b-094529f8500b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:09.729478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:09.730112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:09.730422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:09.730698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] PATH_INFO: `/v3/users/077cb54664e6457dbd31dae1708e8639` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:09.731820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=077cb54664e6457dbd31dae1708e8639)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:09.733732 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:09.779409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077cb54664e6457dbd31dae1708e8639'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:09.779974 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077cb54664e6457dbd31dae1708e8639'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:09.788760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077cb54664e6457dbd31dae1708e8639'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:09.800742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077cb54664e6457dbd31dae1708e8639'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:09.807886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-341946f1-3c89-4157-b9a7-dfa0f4610df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077cb54664e6457dbd31dae1708e8639'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:09.813727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1296/2566] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:34:09 2022] DELETE /identity/v3/users/077cb54664e6457dbd31dae1708e8639 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:34:09.988987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.007248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02bde0-7a33-494c-b337-7c2a2459cb59 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.067694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.068374 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.068650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.068924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] PATH_INFO: `/v3/projects/9301a5dbc4524cb5b6628588ed8cce37` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.070085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9301a5dbc4524cb5b6628588ed8cce37)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.072058 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.120880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9301a5dbc4524cb5b6628588ed8cce37', 'request_id': 'req-0830811d-fd93-401d-a0f8-f2229240451d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:10.127249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9301a5dbc4524cb5b6628588ed8cce37', 'request_id': 'req-0830811d-fd93-401d-a0f8-f2229240451d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:10.133521 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9301a5dbc4524cb5b6628588ed8cce37', 'request_id': 'req-0830811d-fd93-401d-a0f8-f2229240451d'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:10.146945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] The token cache is being invalidate because project 9301a5dbc4524cb5b6628588ed8cce37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:34:10.147230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:10.147859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-0830811d-fd93-401d-a0f8-f2229240451d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:10.149339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1271/2567] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:34:09 2022] DELETE /identity/v3/projects/9301a5dbc4524cb5b6628588ed8cce37 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:34:10.154304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.154590 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.154860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.175124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:10.176332 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:10.236278 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1297/2568] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:10.244480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.244768 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.245043 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.264574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:10.265796 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:10.274188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1272/2569] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:10.278541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.288624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc88c5e-d39d-4a04-8970-427cb32aea92 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.293041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.293665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.293948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.294246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.294893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:34:10.295195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.296782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.308182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1298/2570] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:34:10.312376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.321569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2d132-8573-45f5-848e-e6ef28fd3d44 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.326125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.326744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.327019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.327287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.327915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.329798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.357680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1273/2571] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:34:10 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:34:10.361834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.372528 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe51-5da1-4622-94ac-986f9a50cda2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.416595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:10.430340 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.431004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.431288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.431561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.432229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.434126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.454746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1299/2572] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:34:10 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:34:10.459415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.470011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429ade5-aae6-4009-9f2a-8ea7e90c9698 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.475567 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.476162 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.476444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.476744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.477385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.479074 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.489163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1274/2573] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:34:10.493546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.503596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e98b11-c8e9-4866-a795-500caf085279 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.508176 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.508762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.509041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.509309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.509943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.511551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf836233-5e69-4604-a59a-e68db5362d56 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.522579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1300/2574] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:34:10.526836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.543457 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa844-3f66-414f-b430-9347679e482d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.548148 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.548792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.549070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.549339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] PATH_INFO: `/v3/projects/c4cfda82001344579f0cd49e5f87ed52/users/9a81b6fe6d8d42cdbd2c85d901c128f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.564573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cfda82001344579f0cd49e5f87ed52, user_id=9a81b6fe6d8d42cdbd2c85d901c128f8, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.567249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.578100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:10.584385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1275/2575] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:34:10 2022] PUT /identity/v3/projects/c4cfda82001344579f0cd49e5f87ed52/users/9a81b6fe6d8d42cdbd2c85d901c128f8/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:34:10.590133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548923-8fc8-4575-9813-d095bb1e7015 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.590593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548923-8fc8-4575-9813-d095bb1e7015 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.590896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548923-8fc8-4575-9813-d095bb1e7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.614541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7a548923-8fc8-4575-9813-d095bb1e7015 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:10.616364 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7a548923-8fc8-4575-9813-d095bb1e7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:10.686144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1301/2576] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:10.696466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:10.698728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:10.803037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfc762-dce7-4ccf-8ae3-83cd25639703 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:10.809434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:10.810468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:10.810801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:10.811277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:10.822977 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:10.824644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:10.835582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1276/2577] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:34:15.107005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e7736-7125-4e06-b70a-3ac35e13c108 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:15.107517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e7736-7125-4e06-b70a-3ac35e13c108 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:15.107610 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e7736-7125-4e06-b70a-3ac35e13c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:15.145319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-444e7736-7125-4e06-b70a-3ac35e13c108 None None] MFA Rules not processed for user `9a81b6fe6d8d42cdbd2c85d901c128f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:15.147672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-444e7736-7125-4e06-b70a-3ac35e13c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:15.254391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1302/2578] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:15.261928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:15.263395 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:15.341993 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbafd92-e8ff-42fd-9476-afb4401bdcdc service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:15.347920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:15.348528 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:15.348804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:15.350429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:15.358351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:15.359948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc9a7-ac6b-473e-9c90-37859c4b605e service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:15.370082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1277/2579] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:34:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:34:16.688097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:16.688635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:16.688635 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:16.708177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] MFA Rules not processed for user `9a81b6fe6d8d42cdbd2c85d901c128f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:16.710014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:16.716822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1303/2580] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:34:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:21.482102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c8e-ce19-4812-b1e8-81c930d2c88e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:21.482991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c8e-ce19-4812-b1e8-81c930d2c88e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:21.482991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c8e-ce19-4812-b1e8-81c930d2c88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:21.506071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2c3b5c8e-ce19-4812-b1e8-81c930d2c88e None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:21.507511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2c3b5c8e-ce19-4812-b1e8-81c930d2c88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:21.563664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1278/2581] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:34:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:21.585806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:21.587288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:21.637738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:21.657912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c1248-bff7-4b3a-845d-99a5593bba6c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:21.662865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:21.663465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:21.663740 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:21.664027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:21.671900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:21.673449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:21.681869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1304/2582] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:34:31.556927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=85 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:31.678743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:36.998813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:36.999309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:36.999412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:37.018753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:34:37.019941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:37.027863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1279/2583] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:34:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:34:37.039788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:37.050151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ff60-d27c-4b69-a2b4-54fb5b644e78 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:37.055279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:37.055889 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:37.056149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:37.056425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:37.064249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:37.065814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:37.074591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1305/2584] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:34:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:34:38.977914 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:38.979456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:34:38.994641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65918e-dc4b-4b60-a183-96beaa3a3c22 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:38.999152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:38.999782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:39.000063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:39.000370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] PATH_INFO: `/v3/users/8a3616c29bf3482cadb61dfe502aa64e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:39.001501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3616c29bf3482cadb61dfe502aa64e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:39.003456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:39.050380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3616c29bf3482cadb61dfe502aa64e'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.051027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3616c29bf3482cadb61dfe502aa64e'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.051627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3616c29bf3482cadb61dfe502aa64e'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.059183 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3616c29bf3482cadb61dfe502aa64e'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.071971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3616c29bf3482cadb61dfe502aa64e'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.085624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1280/2585] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:34:38 2022] DELETE /identity/v3/users/8a3616c29bf3482cadb61dfe502aa64e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:34:39.264792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:34:39.276568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa967cf3-d6d9-486a-950d-cf41341ae8dc service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:34:39.332792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:34:39.333419 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:34:39.333693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:34:39.333959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] PATH_INFO: `/v3/projects/6eb8b7d8d3aa461c9972a40069dc2a59` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:34:39.335834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb8b7d8d3aa461c9972a40069dc2a59)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:34:39.337723 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:34:39.382418 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb8b7d8d3aa461c9972a40069dc2a59', 'request_id': 'req-d05aa920-ff6b-4aff-90ae-888d83fa4e70'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.388410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb8b7d8d3aa461c9972a40069dc2a59', 'request_id': 'req-d05aa920-ff6b-4aff-90ae-888d83fa4e70'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.393833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb8b7d8d3aa461c9972a40069dc2a59', 'request_id': 'req-d05aa920-ff6b-4aff-90ae-888d83fa4e70'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.406040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] The token cache is being invalidate because project 6eb8b7d8d3aa461c9972a40069dc2a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:34:39.406360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.406982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:34:39.408435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1306/2586] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:34:39 2022] DELETE /identity/v3/projects/6eb8b7d8d3aa461c9972a40069dc2a59 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:34:49.083783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:34:49.403129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:07.592282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:07.593757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:07.651013 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d83f-3560-4195-82cf-e85717d932b6 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:07.701493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:07.702096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:07.702403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:07.702674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:07.704392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:07.773623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:07.775091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:07.786584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1281/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:14.305954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:14.307383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:14.319598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aa920-ff6b-4aff-90ae-888d83fa4e70 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:14.323163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:14.323756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:14.324030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:14.324296 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:14.325962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:14.387081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:14.388488 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:14.398167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1307/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:17.501391 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:17.503012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:17.517284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4d52-3594-465d-93ec-eec051096b4e service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:17.521890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:17.522562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:17.522842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:17.523116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] PATH_INFO: `/v3/users/91786707d68f4a18a35031db85066d50` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:17.537919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91786707d68f4a18a35031db85066d50)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:17.539893 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:17.581816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:17.588384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91786707d68f4a18a35031db85066d50'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.589330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91786707d68f4a18a35031db85066d50'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.590168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91786707d68f4a18a35031db85066d50'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.597772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91786707d68f4a18a35031db85066d50'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.609525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ed253bc-a800-4812-9c25-f89d0fd16ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91786707d68f4a18a35031db85066d50'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.621880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1282/2589] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:17 2022] DELETE /identity/v3/users/91786707d68f4a18a35031db85066d50 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:17.793068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:17.803871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd624-329b-4289-837c-dda7ad9e10b1 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:17.863442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:17.864087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:17.864363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:17.864637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] PATH_INFO: `/v3/projects/6b5cb3820d334c09a0ff64519331c8ee` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:17.875023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5cb3820d334c09a0ff64519331c8ee)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:17.876925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:17.922456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5cb3820d334c09a0ff64519331c8ee', 'request_id': 'req-bf28ee1b-419a-4c59-8e66-f43b24ca7460'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.928863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5cb3820d334c09a0ff64519331c8ee', 'request_id': 'req-bf28ee1b-419a-4c59-8e66-f43b24ca7460'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.934366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5cb3820d334c09a0ff64519331c8ee', 'request_id': 'req-bf28ee1b-419a-4c59-8e66-f43b24ca7460'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.947509 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] The token cache is being invalidate because project 6b5cb3820d334c09a0ff64519331c8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:17.947811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.948440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bf28ee1b-419a-4c59-8e66-f43b24ca7460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:17.950101 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1308/2590] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:17 2022] DELETE /identity/v3/projects/6b5cb3820d334c09a0ff64519331c8ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:17.955765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:17.956051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:17.956326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:17.976300 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:17.977500 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:18.036546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1283/2591] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:18.044589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.044872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.045145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.065010 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:18.066206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:18.073959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1309/2592] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:18.078728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.088287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc090e-f37d-44a0-8aa3-ff77e48295f5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.092875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.093537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.093814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.094087 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.094757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:18.095061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.096658 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.107961 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1284/2593] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:18.112558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.121603 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84fb3-615e-4c32-be81-0fb6404a5ede None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.126833 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.127426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.127703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.127972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.128597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.130506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.135441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:18.168878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1310/2594] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:18.173054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.182809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5997f4b-2be7-499a-a3be-f8726d42d401 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.240725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.241325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.241601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.241920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.242578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.244473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.266190 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1285/2595] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:18.270116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.280303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7bbe-5724-42ac-a706-91ed0780bb67 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.285544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.286145 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.286457 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.286780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.287373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.288944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.299060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1311/2596] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:18.302988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.313274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417446f-3b36-4ff1-97b1-52fa3e9ac278 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.317847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.318458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.318737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.319009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.319634 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.321215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d957f-f862-4f42-95ba-da8da2c923bd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.332544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1286/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:18.336666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.346497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730f9c6-007e-4bd1-bab8-e331ae55a02c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.351344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.352130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.352414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.352692 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] PATH_INFO: `/v3/projects/9f6267926c2a4e4b9c7fb801894adfb9/users/04d46525c4b94dc68c489ec2918e5a92/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.367881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6267926c2a4e4b9c7fb801894adfb9, user_id=04d46525c4b94dc68c489ec2918e5a92, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.370544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.384608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1312/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:18 2022] PUT /identity/v3/projects/9f6267926c2a4e4b9c7fb801894adfb9/users/04d46525c4b94dc68c489ec2918e5a92/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:18.396017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.396299 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.396570 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.425131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] MFA Rules not processed for user `04d46525c4b94dc68c489ec2918e5a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:18.426372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:18.438623 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:18.491913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1287/2599] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:18.496403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.557734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e38910-39c8-4975-a55d-ef3ef4a0f675 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.563167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.563764 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.564037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.564299 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.564911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.566826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.592409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1313/2600] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:18.596447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.607027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c347c7-bf90-411a-8185-c5eff5d2673c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.662918 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.663556 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.663834 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.664104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.664737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.666668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.688956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1288/2601] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:18.692947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.703483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c89ab-2701-42e2-a609-14f6f272dc20 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.709148 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.709825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.710190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.710560 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.711276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.712969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.725006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1314/2602] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:18.729399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.740012 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1a56-cd77-4e3b-bc98-693fc2810d59 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.744607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.745256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.745535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.745809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] PATH_INFO: `/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223/users/552f96dd4a3c4a36b01b938ae5df9975/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.760600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6c1c1ca4da48fbb6b20a32506ad223, user_id=552f96dd4a3c4a36b01b938ae5df9975, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.763265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.776773 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1289/2603] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:18 2022] PUT /identity/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223/users/552f96dd4a3c4a36b01b938ae5df9975/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:18.781476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.791415 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa18e8b-412a-4fc8-9b16-8f6bab9af838 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.855863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.856558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.856845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.857118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.857754 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.859995 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291bc9f-877c-4444-ab84-1a542f9d67df admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.869841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1315/2604] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:18.874086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:18.884343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3c6fa-ef91-430c-aaa1-b9739daf3da9 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:18.888994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:18.889643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.890106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.890420 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] PATH_INFO: `/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223/users/552f96dd4a3c4a36b01b938ae5df9975/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.892337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6c1c1ca4da48fbb6b20a32506ad223, user_id=552f96dd4a3c4a36b01b938ae5df9975, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:18.895107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:18.905168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1290/2605] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:18 2022] PUT /identity/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223/users/552f96dd4a3c4a36b01b938ae5df9975/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:18.916012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:18.916301 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:18.916579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:18.941554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:18.944584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] MFA Rules not processed for user `552f96dd4a3c4a36b01b938ae5df9975`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:18.946477 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:19.015542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1316/2606] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:19.026809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:19.028485 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:19.086738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca6629-2de7-4a3c-a6aa-3ff5f45573e8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:19.090333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:19.090935 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:19.091216 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:19.091489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:19.101182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:19.102663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b378ef5-5271-47ec-9275-ff566e3334b6 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:19.112390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1291/2607] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:19.518668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:19.579215 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5c19f-67bd-4365-bb55-17c8ea41323b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:19.583628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:19.584247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:19.584525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:19.584801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] PATH_INFO: `/v3/users/04d46525c4b94dc68c489ec2918e5a92` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:19.585910 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d46525c4b94dc68c489ec2918e5a92)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:19.587840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:19.633516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d46525c4b94dc68c489ec2918e5a92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:19.634100 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d46525c4b94dc68c489ec2918e5a92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:19.642022 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d46525c4b94dc68c489ec2918e5a92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:19.653733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d46525c4b94dc68c489ec2918e5a92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:19.660747 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d46525c4b94dc68c489ec2918e5a92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:19.666594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1317/2608] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:19 2022] DELETE /identity/v3/users/04d46525c4b94dc68c489ec2918e5a92 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:19.671225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:19.671862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:19.671862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:19.691172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:19.692405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:19.696364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:19.753279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1292/2609] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:19.762873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:19.764257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:19.784825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:19.823286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a413d-ddca-4a92-a29f-6fdd557b95bb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:19.826950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:19.828279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:19.828587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:19.828862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:19.838037 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:19.839531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:19.849106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1318/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:20.117059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:20.118498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:20.133180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992250d1-0d6b-46f9-9f48-77f4da9a89f6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:20.137745 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:20.138412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.138688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.138958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] PATH_INFO: `/v3/projects/9f6267926c2a4e4b9c7fb801894adfb9` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.140792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6267926c2a4e4b9c7fb801894adfb9)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:20.143381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:20.191196 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6267926c2a4e4b9c7fb801894adfb9', 'request_id': 'req-5d92707b-7ea9-4445-9cb1-291deb187a5b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.198343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6267926c2a4e4b9c7fb801894adfb9', 'request_id': 'req-5d92707b-7ea9-4445-9cb1-291deb187a5b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.204294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6267926c2a4e4b9c7fb801894adfb9', 'request_id': 'req-5d92707b-7ea9-4445-9cb1-291deb187a5b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.216412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] The token cache is being invalidate because project 9f6267926c2a4e4b9c7fb801894adfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:20.216699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.217329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.219336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1293/2611] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:20 2022] DELETE /identity/v3/projects/9f6267926c2a4e4b9c7fb801894adfb9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:20.223264 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:20.232490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afe2cf-6868-4fe2-b5ab-c693737b093c service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:20.288642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:20.289265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.289540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.289809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] PATH_INFO: `/v3/users/552f96dd4a3c4a36b01b938ae5df9975` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.290936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552f96dd4a3c4a36b01b938ae5df9975)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:20.292836 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:20.337162 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552f96dd4a3c4a36b01b938ae5df9975'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.337801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552f96dd4a3c4a36b01b938ae5df9975'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.346483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552f96dd4a3c4a36b01b938ae5df9975'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.357941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552f96dd4a3c4a36b01b938ae5df9975'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.365279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed1e3977-8649-42d0-81a5-23162993bfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552f96dd4a3c4a36b01b938ae5df9975'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.371258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1319/2612] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:20 2022] DELETE /identity/v3/users/552f96dd4a3c4a36b01b938ae5df9975 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:20.648293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:20.650021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:20.669459 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92707b-7ea9-4445-9cb1-291deb187a5b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:20.733964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:20.735097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.735097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.735441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] PATH_INFO: `/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.736386 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6c1c1ca4da48fbb6b20a32506ad223)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:20.738401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:20.779992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:20.792683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6c1c1ca4da48fbb6b20a32506ad223', 'request_id': 'req-05ce9431-10a7-4562-8825-548de17a29bc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.801335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6c1c1ca4da48fbb6b20a32506ad223', 'request_id': 'req-05ce9431-10a7-4562-8825-548de17a29bc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.809465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6c1c1ca4da48fbb6b20a32506ad223', 'request_id': 'req-05ce9431-10a7-4562-8825-548de17a29bc'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.823102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] The token cache is being invalidate because project fe6c1c1ca4da48fbb6b20a32506ad223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:20.823686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.824085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-05ce9431-10a7-4562-8825-548de17a29bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:20.825828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1294/2613] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:20 2022] DELETE /identity/v3/projects/fe6c1c1ca4da48fbb6b20a32506ad223 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:20.831519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.831806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.832086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.852386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:20.853606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:20.888353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:20.916944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1320/2614] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:20.925084 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.925371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.925645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.947464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:20.948698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:20.957653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1295/2615] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:20.962065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:20.973092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122fee9-16cc-4ffb-bd21-b19f7206d120 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:20.978012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:20.978678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:20.978983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:20.979281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:20.979937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:20.980260 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:20.981913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:20.995398 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1321/2616] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:21.000501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.013825 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aa7db-66ab-4131-accd-0512349af282 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.019507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.020111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.020387 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.020673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.021422 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.023397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.051913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1296/2617] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:20 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:21.056155 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.068814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db8dd9-232e-4078-b46e-84262b1aa861 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.135245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.135858 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.136141 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.136421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.137060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.139434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.164473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1322/2618] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:21 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:21.168742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.180941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348b72-5e78-429d-b6fa-c5cb3ad4df10 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.185710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.186402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.186693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.186964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.188377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.189275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.201278 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1297/2619] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:21.205566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.215746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79951c-9411-4181-9d26-c295f860e520 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.221380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.221982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.222288 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.222562 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.223203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.224823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae751e-6267-4a2e-a5ea-2e5deda674df admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.236697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1323/2620] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:35:21.240987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.254133 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24dd61-021c-4930-a8f9-eb837f4dac4e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.258978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.259633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.259909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.260179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] PATH_INFO: `/v3/projects/06ab4914ee7c4ae0aca227ebb486737f/users/55228e135cd749c2928ceef0a4dafd93/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.279137 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ab4914ee7c4ae0aca227ebb486737f, user_id=55228e135cd749c2928ceef0a4dafd93, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.282894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.297297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1298/2621] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:21 2022] PUT /identity/v3/projects/06ab4914ee7c4ae0aca227ebb486737f/users/55228e135cd749c2928ceef0a4dafd93/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:21.309125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.309404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.309675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.339240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] MFA Rules not processed for user `55228e135cd749c2928ceef0a4dafd93`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:21.340463 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:21.406236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1324/2622] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:21.411005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.473950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b7350-edb3-4fd9-ab6c-331e58b55d4f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.478651 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.479475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.479751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.480019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.480680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.482663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.509760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1299/2623] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:21 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:21.513957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.525500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e3853-5715-4b1d-942d-617ef64ffa57 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.557646 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:21.582940 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.583546 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.583823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.584089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.584713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.586724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.608877 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1325/2624] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:21 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:35:21.612891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.624268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea600584-4c46-4569-b8ec-d8700e9b019f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.628852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.629446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.629723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.629997 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.630668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.632252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.643381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1300/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:21.647642 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.658275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc796c-5bf1-4cb9-8db4-e59655eb2a6e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.662862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.663506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.663784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.664061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] PATH_INFO: `/v3/projects/80f77f01f222409ea8a87db72cf3a262/users/e10a0c709a884af18d8c2dbf568acd26/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.678963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f77f01f222409ea8a87db72cf3a262, user_id=e10a0c709a884af18d8c2dbf568acd26, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.681846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.694899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1326/2626] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:21 2022] PUT /identity/v3/projects/80f77f01f222409ea8a87db72cf3a262/users/e10a0c709a884af18d8c2dbf568acd26/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:21.698857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.709406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d360261-3357-45b6-83d8-b297aedcc376 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.739525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:21.768789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.769321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.769601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.769873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.770543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.772125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720708b-ea48-45e8-9fa8-50eee366ac36 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.781858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1301/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:21.786319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.796714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe2cf-2f5b-4d02-b294-f3a6870f13f7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.801249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.801885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.802164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.802481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] PATH_INFO: `/v3/projects/80f77f01f222409ea8a87db72cf3a262/users/e10a0c709a884af18d8c2dbf568acd26/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.804366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f77f01f222409ea8a87db72cf3a262, user_id=e10a0c709a884af18d8c2dbf568acd26, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:21.807001 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:21.817554 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1327/2628] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:21 2022] PUT /identity/v3/projects/80f77f01f222409ea8a87db72cf3a262/users/e10a0c709a884af18d8c2dbf568acd26/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:21.828844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.829122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.829388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:21.857330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] MFA Rules not processed for user `e10a0c709a884af18d8c2dbf568acd26`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:21.858901 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:21.924775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1302/2629] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:35:21.935401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:21.937790 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:21.994161 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3f14-87c1-4370-84d1-ff920782071d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:21.997829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:21.998987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:21.999351 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:21.999656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.009885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:22.011737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19367f-42f1-481d-9958-547288ac3014 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:22.022414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1328/2630] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:22.158289 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:22.220882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f258-76cf-4b0d-a5f9-188ad29d0d0b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:22.225324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:22.225946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:22.226243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:22.226542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] PATH_INFO: `/v3/users/55228e135cd749c2928ceef0a4dafd93` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.227648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55228e135cd749c2928ceef0a4dafd93)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:22.229554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:22.274794 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55228e135cd749c2928ceef0a4dafd93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.275373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55228e135cd749c2928ceef0a4dafd93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.275985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55228e135cd749c2928ceef0a4dafd93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.282850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55228e135cd749c2928ceef0a4dafd93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.283937 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:22.296859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55228e135cd749c2928ceef0a4dafd93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.309082 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1303/2631] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:22 2022] DELETE /identity/v3/users/55228e135cd749c2928ceef0a4dafd93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:22.314276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:22.314763 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:22.314862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.333106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:22.334321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:22.392021 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1329/2632] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:22.401572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:22.402994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:22.459656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726089-2166-439b-ae96-495f578da288 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:22.463321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:22.463923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:22.464201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:22.464471 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.474000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:22.475467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:22.485618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1304/2633] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:22.752441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:22.754017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:22.775762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4482a-6e46-42b7-972d-ab9def7fbb15 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:22.781274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:22.781913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:22.782195 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:22.782499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] PATH_INFO: `/v3/projects/06ab4914ee7c4ae0aca227ebb486737f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.783631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ab4914ee7c4ae0aca227ebb486737f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:22.785564 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:22.817366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:22.835999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ab4914ee7c4ae0aca227ebb486737f', 'request_id': 'req-426a5325-903a-47dd-b545-1f6180e945f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.843190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ab4914ee7c4ae0aca227ebb486737f', 'request_id': 'req-426a5325-903a-47dd-b545-1f6180e945f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.848745 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ab4914ee7c4ae0aca227ebb486737f', 'request_id': 'req-426a5325-903a-47dd-b545-1f6180e945f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.861032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] The token cache is being invalidate because project 06ab4914ee7c4ae0aca227ebb486737f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:22.861319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.861927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.863400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1330/2634] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:22 2022] DELETE /identity/v3/projects/06ab4914ee7c4ae0aca227ebb486737f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:22.867480 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:22.876832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f414e-e965-4a91-b58d-5b203546bb54 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:22.932735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:22.933361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:22.933642 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:22.933920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] PATH_INFO: `/v3/users/e10a0c709a884af18d8c2dbf568acd26` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:22.935070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10a0c709a884af18d8c2dbf568acd26)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:22.937080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:22.981352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10a0c709a884af18d8c2dbf568acd26'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.982001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10a0c709a884af18d8c2dbf568acd26'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.982693 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10a0c709a884af18d8c2dbf568acd26'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:22.989732 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10a0c709a884af18d8c2dbf568acd26'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.001520 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-82d80be8-1b6a-48f1-aefb-c3b75c6b9f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10a0c709a884af18d8c2dbf568acd26'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.005136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:23.016092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1305/2635] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:22 2022] DELETE /identity/v3/users/e10a0c709a884af18d8c2dbf568acd26 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:23.282971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.284355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:23.298134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a5325-903a-47dd-b545-1f6180e945f4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.354761 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.355436 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.355660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.355937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] PATH_INFO: `/v3/projects/80f77f01f222409ea8a87db72cf3a262` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.357055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f77f01f222409ea8a87db72cf3a262)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.359283 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.407085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f77f01f222409ea8a87db72cf3a262', 'request_id': 'req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.412921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f77f01f222409ea8a87db72cf3a262', 'request_id': 'req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.418421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f77f01f222409ea8a87db72cf3a262', 'request_id': 'req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.430361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] The token cache is being invalidate because project 80f77f01f222409ea8a87db72cf3a262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:23.430651 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.431262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5b6be261-13ef-4003-a5f1-1ad88a1a8bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:23.432695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1331/2636] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:23 2022] DELETE /identity/v3/projects/80f77f01f222409ea8a87db72cf3a262 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:23.438343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.438646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.438919 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.460388 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:23.461635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:23.520636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1306/2637] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:23.528608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.528894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.529178 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.548490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:23.549682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:23.557461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1332/2638] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:23.562339 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.572425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4f9ea-b573-4e07-916d-3390a55e1084 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.577838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.578467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.578750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.579026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.579668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:23.579974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.581582 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.593333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1307/2639] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:23.597555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.606781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb277-bafa-4a7a-ab1d-f02741172f01 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.612184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.612777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.613054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.613345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.613988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.615913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.643421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1333/2640] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:23 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:23.647475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.657496 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11b6a-7c61-4594-ae87-7ad72dd360fc admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.713606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.714231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.714526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.714804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.715443 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.717408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.738912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1308/2641] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:23 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:23.742976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.753972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560e1e-1d6e-4f6e-bd1a-836b9cf72001 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.758512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.759108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.759388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.759659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.760295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.761870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.771988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1334/2642] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:23.775791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.785957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63987247-fe73-448c-a1f9-3e42da7387de admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.790648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.791266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.791546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.791818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.792446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.794036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2a166-a160-4b0b-b427-f5ad1b0c2227 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.805059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1309/2643] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:23.809237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.816183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:23.820479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5f337-11e7-4dbc-9639-3552ac4b3ace admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:23.826869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:23.827885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.828500 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.829108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] PATH_INFO: `/v3/projects/3dae4b7a32224ca99c78cdec6b4d054b/users/551d14903e184fa7a51b8a8788e1b81c/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.843865 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dae4b7a32224ca99c78cdec6b4d054b, user_id=551d14903e184fa7a51b8a8788e1b81c, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:23.846530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:23.859810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1335/2644] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:23 2022] PUT /identity/v3/projects/3dae4b7a32224ca99c78cdec6b4d054b/users/551d14903e184fa7a51b8a8788e1b81c/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:23.871166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:23.871637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:23.871777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:23.899548 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] MFA Rules not processed for user `551d14903e184fa7a51b8a8788e1b81c`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:23.900746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:23.947862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:23.965760 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1310/2645] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:35:23.977690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:23.979498 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.035589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70d11-3114-403f-80fa-6f6823eaf151 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.039244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.039845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.040123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.040395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.050857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.052271 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bde79-d11c-468f-b1e8-6613cad3e26c service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.061020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1336/2646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:24.082519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:24.143470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16115bd-6769-4f0b-9fef-5efc373cc57d None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.148017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.148632 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.148909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.149177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] PATH_INFO: `/v3/users/551d14903e184fa7a51b8a8788e1b81c` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.150309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=551d14903e184fa7a51b8a8788e1b81c)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.152203 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.197960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551d14903e184fa7a51b8a8788e1b81c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.198543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551d14903e184fa7a51b8a8788e1b81c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.199167 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551d14903e184fa7a51b8a8788e1b81c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.206002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551d14903e184fa7a51b8a8788e1b81c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.218996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551d14903e184fa7a51b8a8788e1b81c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.233599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1311/2647] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:24 2022] DELETE /identity/v3/users/551d14903e184fa7a51b8a8788e1b81c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:24.238434 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.238741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.239012 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.257964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:24.259191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.317729 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1337/2648] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:24.328423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:24.329857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.385589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac90c-fbcd-4517-9a9a-4b344959f9e5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.389808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.390431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.390708 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.390976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.399705 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.401117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594683a1-074c-488e-9ec2-20ce32b3277e service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.411096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1312/2649] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:24.671405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:24.672893 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.689156 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b7946-6bdd-4f68-90a6-17ab9d3d1d21 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.694597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.695281 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.695675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.695777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] PATH_INFO: `/v3/projects/3dae4b7a32224ca99c78cdec6b4d054b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.697047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dae4b7a32224ca99c78cdec6b4d054b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.698999 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.745730 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dae4b7a32224ca99c78cdec6b4d054b', 'request_id': 'req-d4639291-1575-456c-ba94-44098cb2e593'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.752490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dae4b7a32224ca99c78cdec6b4d054b', 'request_id': 'req-d4639291-1575-456c-ba94-44098cb2e593'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.760379 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dae4b7a32224ca99c78cdec6b4d054b', 'request_id': 'req-d4639291-1575-456c-ba94-44098cb2e593'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.776470 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] The token cache is being invalidate because project 3dae4b7a32224ca99c78cdec6b4d054b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:24.776767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.777394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4639291-1575-456c-ba94-44098cb2e593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:24.778921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1338/2650] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:24 2022] DELETE /identity/v3/projects/3dae4b7a32224ca99c78cdec6b4d054b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:24.783872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.784185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.784462 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.809416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:24.811351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.820284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:24.874591 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1313/2651] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:24.882250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28251d2f-7886-484b-b072-522029286f05 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.882535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28251d2f-7886-484b-b072-522029286f05 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.882817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28251d2f-7886-484b-b072-522029286f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.897629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:24.903925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-28251d2f-7886-484b-b072-522029286f05 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:24.905821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-28251d2f-7886-484b-b072-522029286f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:24.914081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1339/2652] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:24.918194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:24.928251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131d77-8696-434d-ae8f-2e1e35a1f0d8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.932818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.933413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.933694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.933971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.934644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:24.934951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.937358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.948913 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1314/2653] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:24.953875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28251d2f-7886-484b-b072-522029286f05 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:24.963276 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28251d2f-7886-484b-b072-522029286f05 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:24.967960 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:24.968555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:24.968835 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:24.969109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:24.969748 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:24.971686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:24.999068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1340/2654] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:24 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:35:25.003230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.012781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5332a4-c41a-4029-8b2a-5200f249c1ac admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.068385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.068988 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.069265 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.069542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.070192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.072131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.093221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1315/2655] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:25 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:35:25.097274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.108076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dca2d5-e323-449e-a29d-da89af5bceaf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.112574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.113157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.113432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.113716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.114385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.115952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.126137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1341/2656] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:25.129855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.140279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8e3f-6d8d-4661-98a7-587cbd024194 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.144953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.145539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.145817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.146088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.146787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.148371 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf5b4-8f8c-4cf4-be72-6a73dbf4d5ec admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.158941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1316/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:25.162744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.173392 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ac3da-e880-434f-b27f-63f529ff9199 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.177913 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.178582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.178856 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.179129 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] PATH_INFO: `/v3/projects/2af504012e304d9b9199a398f96448a6/users/f9f190d66952460e88f0f6f8da6a2679/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.194628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af504012e304d9b9199a398f96448a6, user_id=f9f190d66952460e88f0f6f8da6a2679, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.197314 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.209738 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1342/2658] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:25 2022] PUT /identity/v3/projects/2af504012e304d9b9199a398f96448a6/users/f9f190d66952460e88f0f6f8da6a2679/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:25.220171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.220482 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.220757 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.249194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] MFA Rules not processed for user `f9f190d66952460e88f0f6f8da6a2679`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:25.250440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:25.313429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1317/2659] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:25.317848 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.379095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5cc5-dd08-4a31-b922-1129a2dee228 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.383674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.384262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.384538 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.384808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.385432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.387341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.413701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1343/2660] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:25 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:25.417798 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.429061 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ed92-9235-498f-9194-603eef106dd3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.433644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:25.487985 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.488617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.488898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.489171 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.489811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.491791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.512296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1318/2661] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:25 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:35:25.516320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.526658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e83f22-3366-41c4-83b9-53483ddf280f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.532008 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.532637 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.532919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.533190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.533827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.535438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.547516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1344/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:25.551630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.562229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79627f5-d838-41c1-9b9b-9533c2cff369 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.566903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.567479 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.567753 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.568020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] PATH_INFO: `/v3/projects/f929fb490c4847ccb96da2d83d22e336/users/3f037dab8fd1496f910ae2b62d7f153e/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.583053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f929fb490c4847ccb96da2d83d22e336, user_id=3f037dab8fd1496f910ae2b62d7f153e, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.585964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.598928 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1319/2663] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:25 2022] PUT /identity/v3/projects/f929fb490c4847ccb96da2d83d22e336/users/3f037dab8fd1496f910ae2b62d7f153e/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:25.602816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.613484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ead32-b5eb-47f9-bdb4-68707b89b5cf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.668383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.668976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.669304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.670473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.670916 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.672479 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef556-1ab7-45f5-aa2b-da07e7cca9ac admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.681840 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1345/2664] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:25.686335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.696431 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13246d0-7ed4-442d-9585-92fb4f1adc51 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.701249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.701899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.702180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.702505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] PATH_INFO: `/v3/projects/f929fb490c4847ccb96da2d83d22e336/users/3f037dab8fd1496f910ae2b62d7f153e/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.704428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f929fb490c4847ccb96da2d83d22e336, user_id=3f037dab8fd1496f910ae2b62d7f153e, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.707129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.718010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1320/2665] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:25 2022] PUT /identity/v3/projects/f929fb490c4847ccb96da2d83d22e336/users/3f037dab8fd1496f910ae2b62d7f153e/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:35:25.728992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.729273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.729543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.755029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:25.758138 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] MFA Rules not processed for user `3f037dab8fd1496f910ae2b62d7f153e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:25.760134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:25.830305 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1346/2666] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:25.842092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:25.843940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:25.899888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbf5e-a394-4358-ae7b-78d90e7e5afb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:25.904361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:25.904989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:25.905270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:25.905565 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:25.959579 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:25.960994 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5af484-4897-4a31-9ad8-1cd8a6010f4a service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:25.970243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1321/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:28.509653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:28.570926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fbe98-ef59-495f-877f-03a1c4fe7325 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:28.576403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:28.577020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:28.577295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:28.577566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] PATH_INFO: `/v3/users/f9f190d66952460e88f0f6f8da6a2679` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:28.578690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f190d66952460e88f0f6f8da6a2679)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:28.580578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:28.625417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f190d66952460e88f0f6f8da6a2679'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:28.626068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f190d66952460e88f0f6f8da6a2679'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:28.633095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f190d66952460e88f0f6f8da6a2679'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:28.646053 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f190d66952460e88f0f6f8da6a2679'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:28.652758 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f190d66952460e88f0f6f8da6a2679'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:28.659075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1347/2668] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:28 2022] DELETE /identity/v3/users/f9f190d66952460e88f0f6f8da6a2679 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:28.663535 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:28.664006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:28.664116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:28.683597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:28.685941 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:28.694922 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:28.751934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1322/2669] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:28.761469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:28.763515 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:28.783816 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:28.823536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af185d19-78eb-4954-99b1-14f179789882 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:28.827951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:28.828594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:28.828872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:28.829144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:28.838491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:28.839949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:28.849390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1348/2670] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:29.109883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:29.111379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:29.124049 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700041c-6da1-4428-8cb8-a8fb991a47f9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:29.128578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:29.129251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.129586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.129787 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] PATH_INFO: `/v3/projects/2af504012e304d9b9199a398f96448a6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.130924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af504012e304d9b9199a398f96448a6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:29.133003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:29.180595 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af504012e304d9b9199a398f96448a6', 'request_id': 'req-3d413deb-9409-44b1-8e2f-5b233e395c3f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.187252 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af504012e304d9b9199a398f96448a6', 'request_id': 'req-3d413deb-9409-44b1-8e2f-5b233e395c3f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.192801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af504012e304d9b9199a398f96448a6', 'request_id': 'req-3d413deb-9409-44b1-8e2f-5b233e395c3f'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.205559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] The token cache is being invalidate because project 2af504012e304d9b9199a398f96448a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:29.205846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.206503 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.207978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1323/2671] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:29 2022] DELETE /identity/v3/projects/2af504012e304d9b9199a398f96448a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:29.211939 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:29.222034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b9045-d529-4bbc-91c3-514c72e01aeb service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:29.276838 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:29.277378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.277676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.278466 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] PATH_INFO: `/v3/users/3f037dab8fd1496f910ae2b62d7f153e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.279589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f037dab8fd1496f910ae2b62d7f153e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:29.281489 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:29.325196 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f037dab8fd1496f910ae2b62d7f153e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.325837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f037dab8fd1496f910ae2b62d7f153e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.333078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f037dab8fd1496f910ae2b62d7f153e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.346819 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f037dab8fd1496f910ae2b62d7f153e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.353746 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d0396596-5ccb-468f-97fa-984af9a45f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f037dab8fd1496f910ae2b62d7f153e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.360390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1349/2672] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:29 2022] DELETE /identity/v3/users/3f037dab8fd1496f910ae2b62d7f153e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:29.636230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:29.638507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:29.651377 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d413deb-9409-44b1-8e2f-5b233e395c3f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:29.709023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:29.709666 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.709929 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.710207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] PATH_INFO: `/v3/projects/f929fb490c4847ccb96da2d83d22e336` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.711354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f929fb490c4847ccb96da2d83d22e336)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:29.713256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:29.753784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:29.760981 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f929fb490c4847ccb96da2d83d22e336', 'request_id': 'req-f8a747c4-7d20-4f94-8ee3-92a37edf0372'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.767954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f929fb490c4847ccb96da2d83d22e336', 'request_id': 'req-f8a747c4-7d20-4f94-8ee3-92a37edf0372'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.773613 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f929fb490c4847ccb96da2d83d22e336', 'request_id': 'req-f8a747c4-7d20-4f94-8ee3-92a37edf0372'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.786950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] The token cache is being invalidate because project f929fb490c4847ccb96da2d83d22e336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:29.787245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.787878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-f8a747c4-7d20-4f94-8ee3-92a37edf0372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:29.789401 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1324/2673] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:29 2022] DELETE /identity/v3/projects/f929fb490c4847ccb96da2d83d22e336 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:29.794130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.794674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.794778 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.814432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:29.815561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:29.849714 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:29.877122 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1350/2674] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:29.884781 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.885064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.885336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.906397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:29.907870 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:29.916007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1325/2675] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:29.920531 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:29.930422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310186f-4efe-4c46-83a2-70dad5484e1c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:29.935753 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:29.936386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.936664 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.936934 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.937690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:29.937993 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:29.939607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:29.951902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1351/2676] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:29.955990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:29.965182 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200b20-d9b4-4ba2-a217-26a77c322a7e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:29.969895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:29.970525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:29.970801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:29.971094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:29.971724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:29.973622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.000716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1326/2677] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:29 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:30.004830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:30.015439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c8440-20af-425d-a7d8-a2c4a503cd9a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:30.070157 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:30.070727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.070988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.071258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.071873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:30.073759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.096356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1352/2678] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:30 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:30.100601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:30.111026 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77322e-44a2-44fa-88e5-770ef3d7d401 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:30.115593 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:30.116186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.116468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.116739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.117370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:30.119017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.129242 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1327/2679] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:30.133073 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:30.143561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78229d-9aaf-4499-a4d7-9c26e59f99c7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:30.148128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:30.148717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.149000 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.149275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.149912 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:30.151558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3d234-dcbb-4793-b85e-13d1d9bd2c7a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.163403 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1353/2680] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:30.167337 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:30.177869 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0485-ccbf-4b89-b001-c038dfee37cd admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:30.182807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:30.183439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.183713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.184011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] PATH_INFO: `/v3/projects/c398b7743c3f412db5f4da9d22c73b78/users/ee1fb09b5bfe48d591799b94341dcf56/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.199293 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c398b7743c3f412db5f4da9d22c73b78, user_id=ee1fb09b5bfe48d591799b94341dcf56, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:30.202328 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.214486 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1328/2681] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:30 2022] PUT /identity/v3/projects/c398b7743c3f412db5f4da9d22c73b78/users/ee1fb09b5bfe48d591799b94341dcf56/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:30.226385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.226674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.226950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.254794 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] MFA Rules not processed for user `ee1fb09b5bfe48d591799b94341dcf56`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:30.256004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:30.318948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1354/2682] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:30.330475 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:30.332152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:30.388938 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1342-377f-4b07-a1e1-d56c1d644dea admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:30.392633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:30.393232 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:30.393510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:30.393783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:30.401933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:30.403974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:30.412612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1329/2683] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:31.193318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:31.194920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:31.234032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:31.251653 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17161b83-8473-46f9-800e-5c0d9f25abfb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:31.255205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:31.255811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:31.256089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:31.256362 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:31.258074 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:31.268049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:31.269461 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374876-c16d-4e10-8624-83b6ee66349f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:31.277460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1355/2684] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:40.408797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:41.273744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:43.911958 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:43.973187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0274-d8e1-44b3-a565-e6e8dd295cd6 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:43.977650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:43.978296 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:43.978879 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:43.979356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] PATH_INFO: `/v3/users/ee1fb09b5bfe48d591799b94341dcf56` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:43.980631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1fb09b5bfe48d591799b94341dcf56)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:43.982574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.029338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1fb09b5bfe48d591799b94341dcf56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.029968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1fb09b5bfe48d591799b94341dcf56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.030578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1fb09b5bfe48d591799b94341dcf56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.037333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1fb09b5bfe48d591799b94341dcf56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.049259 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1fb09b5bfe48d591799b94341dcf56'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.061947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1330/2685] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:43 2022] DELETE /identity/v3/users/ee1fb09b5bfe48d591799b94341dcf56 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:44.066545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.067018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.067130 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.086438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:44.087622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:44.145728 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1356/2686] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:44.156000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.157390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:44.216542 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5534-f064-45c8-9402-c45498c57665 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.220125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.220726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.221004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.221274 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.230433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.231857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a0c03-a6df-490c-b1a8-ea0ab1228afb service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.241070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1331/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:44.499545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.501023 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:44.515857 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad594-4c61-4f2a-af0b-b1b1622afb67 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.520618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.521259 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.521536 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.521810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] PATH_INFO: `/v3/projects/c398b7743c3f412db5f4da9d22c73b78` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.522975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c398b7743c3f412db5f4da9d22c73b78)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.524925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.571246 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c398b7743c3f412db5f4da9d22c73b78', 'request_id': 'req-319e80d5-a047-461e-8256-18af49fd65c0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.578075 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c398b7743c3f412db5f4da9d22c73b78', 'request_id': 'req-319e80d5-a047-461e-8256-18af49fd65c0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.583800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c398b7743c3f412db5f4da9d22c73b78', 'request_id': 'req-319e80d5-a047-461e-8256-18af49fd65c0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.596787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] The token cache is being invalidate because project c398b7743c3f412db5f4da9d22c73b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:44.597106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.597724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-319e80d5-a047-461e-8256-18af49fd65c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:44.599245 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1357/2688] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:44 2022] DELETE /identity/v3/projects/c398b7743c3f412db5f4da9d22c73b78 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:44.604539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.604827 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.605104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.624849 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:44.626263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:44.643835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:44.691347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1332/2689] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:44.700864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.701144 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.701417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.721724 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:44.722966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:44.731713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1358/2690] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:44.735783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.745498 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc59696-6b2c-4def-994e-893c582351ac None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.750106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.750736 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.751020 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.751294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.751939 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:44.752245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.753846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.766089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1333/2691] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 13:35:44.770447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.780820 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ac4cf-cbda-474c-a742-759ba2a14a36 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.785385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.786136 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.786438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.786706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.787339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.789203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.816252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1359/2692] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:44.820432 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.831470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dec7f7-5c17-46b5-bcff-b5169893f930 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.889375 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.889895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.890181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.890492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.891117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.893041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.914184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1334/2693] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:44 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:44.918941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.929111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15b91-3002-4852-a5f3-4897ef45e3f1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.934151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.934773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.935047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.935317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.935997 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.937565 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.947249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1360/2694] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:44.951584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.961464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fb59-8723-49a1-8f04-c89fba17bb22 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.966191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:44.966808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:44.967117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:44.967390 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:44.968023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:44.969726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57704629-16b6-4e67-b7d7-c0ff3dfaaf91 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:44.980549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1335/2695] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:44.984433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:44.994870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb11b5-bac6-43f7-aa57-dc508856f764 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:44.999751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.000394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.000701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.000972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] PATH_INFO: `/v3/projects/e419f76d61c34a7c8ef1a7a9e2ecf478/users/0c6dfc7a5ca047369b6ab734e6bea61b/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.016408 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e419f76d61c34a7c8ef1a7a9e2ecf478, user_id=0c6dfc7a5ca047369b6ab734e6bea61b, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.019082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.031490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1361/2696] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:44 2022] PUT /identity/v3/projects/e419f76d61c34a7c8ef1a7a9e2ecf478/users/0c6dfc7a5ca047369b6ab734e6bea61b/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:35:45.041674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.041968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.042264 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.069858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] MFA Rules not processed for user `0c6dfc7a5ca047369b6ab734e6bea61b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:45.071144 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:45.133932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1336/2697] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:45.139147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.160232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:45.203158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a958a9-a89c-4b01-bddc-5b3319fdf3f9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.207891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.208491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.208771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.209046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.209686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.211613 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.238834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1362/2698] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:45.242878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.253363 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec73dba-5752-45ab-897e-88c12e86ced5 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.265916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:45.311168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.311770 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.312050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.312320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.312953 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.314907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.336281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1337/2699] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:45.340467 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.350581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f14cc-e2fb-44cc-805c-0a64e800571b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.356321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.356928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.357209 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.357484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.358151 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.359774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.370841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1363/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:45.374631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.384326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fbe8a-af76-4ae0-9ac6-722a7f892122 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.389566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.390146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.390451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.390719 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.391347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.392912 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c05-a4a8-4287-8b5d-19fb92327e5b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.403336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1338/2701] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:45.407423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.417442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a5fb6-9889-4e17-a572-5a814a77b4c8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.421944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.422618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.422899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.423173 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] PATH_INFO: `/v3/projects/f97eb24cbddb40688dcfc0bf259f7a44/users/974662b430a848f4905d565dadc7e764/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.438589 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97eb24cbddb40688dcfc0bf259f7a44, user_id=974662b430a848f4905d565dadc7e764, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.441228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.454208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1364/2702] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:45 2022] PUT /identity/v3/projects/f97eb24cbddb40688dcfc0bf259f7a44/users/974662b430a848f4905d565dadc7e764/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:45.520425 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.520710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.520987 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.549150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] MFA Rules not processed for user `974662b430a848f4905d565dadc7e764`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:45.550416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:45.612969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1339/2703] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:45.617491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.685383 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61f494-418f-41f4-9684-6bec47edd351 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.689933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.690566 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.690847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.691121 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.691752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.693630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.720760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1365/2704] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:45.724868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.736415 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573555b6-1262-498d-800e-ae78db8aa2c8 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.792277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.792883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.793160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.793429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.794076 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.796016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.817707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1340/2705] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:45 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:45.821809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.832411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2e5f-53c7-4ea1-a67d-43226f3edb7e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.837143 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.838303 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.838552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.838900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.839542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.841133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.851797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1366/2706] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:35:45.856897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.866792 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9d6b4-eadd-47af-b1d0-ce9d94512d01 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.871635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.872270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.872544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.872813 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] PATH_INFO: `/v3/projects/2558b8041dd8468883b991833cb06d0e/users/984966a714d2442e9b5a2b0b2288776f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.884550 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:45.888175 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2558b8041dd8468883b991833cb06d0e, user_id=984966a714d2442e9b5a2b0b2288776f, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.891387 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.904816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1341/2707] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:45 2022] PUT /identity/v3/projects/2558b8041dd8468883b991833cb06d0e/users/984966a714d2442e9b5a2b0b2288776f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:45.908685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:45.919553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb847b7-436a-4976-ac5e-2b0d29a18c27 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:45.959581 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:45.975234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:45.975834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:45.976115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:45.976402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:45.977033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:45.979880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa067148-ab03-416d-abdc-969971f606df admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:45.989406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1367/2708] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:45.993502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:46.003848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7820-a4bb-4222-9c67-d75d32f53aaa admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:46.008610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:46.009350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:46.010204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:46.010544 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] PATH_INFO: `/v3/projects/2558b8041dd8468883b991833cb06d0e/users/984966a714d2442e9b5a2b0b2288776f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:46.012585 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2558b8041dd8468883b991833cb06d0e, user_id=984966a714d2442e9b5a2b0b2288776f, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:46.015314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:46.026093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1342/2709] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:45 2022] PUT /identity/v3/projects/2558b8041dd8468883b991833cb06d0e/users/984966a714d2442e9b5a2b0b2288776f/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:46.036095 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:46.036382 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:46.036657 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:46.064005 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] MFA Rules not processed for user `984966a714d2442e9b5a2b0b2288776f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:46.065221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:46.133310 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1368/2710] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:46.145517 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:46.147207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:46.204780 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f5d3-66d8-403b-9d25-f09fe691c543 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:46.208446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:46.209063 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:46.209327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:46.209649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:46.266088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:46.267534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:46.276867 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1343/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:47.777111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:47.778535 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:47.790428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433dae9-ca10-4f06-b8d4-0ebf11ad6733 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:47.794194 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:47.794831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:47.795109 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:47.795380 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:47.852384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:47.854105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:47.862872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1369/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:48.392335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:48.400923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c91e3-bb14-4be6-a9a8-7f5557ccd29d service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:48.404562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:48.405156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:48.405439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:48.405714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:48.414497 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:48.416519 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa70a7-217f-4a50-a8e6-050b391db2b7 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:48.425789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1344/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:52.287057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:52.350894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04278-69d4-468b-b7a1-0fa205219a6a service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:52.356475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:52.357097 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:52.357372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:52.357639 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] PATH_INFO: `/v3/users/0c6dfc7a5ca047369b6ab734e6bea61b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:52.358788 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6dfc7a5ca047369b6ab734e6bea61b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:52.360734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:52.365258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:52.410409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6dfc7a5ca047369b6ab734e6bea61b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.411059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6dfc7a5ca047369b6ab734e6bea61b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.419089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6dfc7a5ca047369b6ab734e6bea61b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.430737 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6dfc7a5ca047369b6ab734e6bea61b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.437435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6dfc7a5ca047369b6ab734e6bea61b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.443190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1370/2714] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:52 2022] DELETE /identity/v3/users/0c6dfc7a5ca047369b6ab734e6bea61b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:52.447746 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:52.448233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:52.448345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:52.468473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:52.469682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:52.527686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1345/2715] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:52.537273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:52.538711 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:52.595936 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40875-6536-486b-801c-08c22923f97e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:52.599584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:52.600186 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:52.600465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:52.600734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:52.610249 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:52.611675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:52.621449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1371/2716] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:35:52.890125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:52.891568 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:52.906523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5826a1-bc0b-4326-b47f-e985c5adda0c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:52.911694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:52.912804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:52.913102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:52.913569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] PATH_INFO: `/v3/projects/e419f76d61c34a7c8ef1a7a9e2ecf478` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:52.914737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e419f76d61c34a7c8ef1a7a9e2ecf478)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:52.916890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:52.932946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:52.964641 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e419f76d61c34a7c8ef1a7a9e2ecf478', 'request_id': 'req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.970629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e419f76d61c34a7c8ef1a7a9e2ecf478', 'request_id': 'req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.976000 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e419f76d61c34a7c8ef1a7a9e2ecf478', 'request_id': 'req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.988402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] The token cache is being invalidate because project e419f76d61c34a7c8ef1a7a9e2ecf478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:52.988690 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.989310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:52.990824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1346/2717] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:52 2022] DELETE /identity/v3/projects/e419f76d61c34a7c8ef1a7a9e2ecf478 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:52.994864 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:53.005029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d24f5-5039-4319-8ff7-6eb515d436e0 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:53.059959 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:53.060506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:53.060787 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:53.061065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] PATH_INFO: `/v3/users/974662b430a848f4905d565dadc7e764` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:53.062175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974662b430a848f4905d565dadc7e764)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:53.064099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:53.093309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:53.112695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974662b430a848f4905d565dadc7e764'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.113337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974662b430a848f4905d565dadc7e764'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.120329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974662b430a848f4905d565dadc7e764'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.132061 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974662b430a848f4905d565dadc7e764'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.139366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974662b430a848f4905d565dadc7e764'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.145102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1372/2718] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:52 2022] DELETE /identity/v3/users/974662b430a848f4905d565dadc7e764 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:53.407903 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:53.409465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:53.424839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa1ecc-56ea-4ee8-b316-82d7008990c8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:53.485001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:53.485749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:53.485905 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:53.486263 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] PATH_INFO: `/v3/projects/f97eb24cbddb40688dcfc0bf259f7a44` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:53.487389 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97eb24cbddb40688dcfc0bf259f7a44)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:53.489321 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:53.535317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97eb24cbddb40688dcfc0bf259f7a44', 'request_id': 'req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.541352 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97eb24cbddb40688dcfc0bf259f7a44', 'request_id': 'req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.547030 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97eb24cbddb40688dcfc0bf259f7a44', 'request_id': 'req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.559113 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] The token cache is being invalidate because project f97eb24cbddb40688dcfc0bf259f7a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:53.559402 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.560031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.561494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1347/2719] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:53 2022] DELETE /identity/v3/projects/f97eb24cbddb40688dcfc0bf259f7a44 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:53.565410 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:53.566854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:53.579831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d411-a1e2-4950-b250-bb528b1c0977 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:53.637356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:53.637901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:53.638177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:53.638478 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] PATH_INFO: `/v3/users/984966a714d2442e9b5a2b0b2288776f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:53.639584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984966a714d2442e9b5a2b0b2288776f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:53.641486 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:53.687733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984966a714d2442e9b5a2b0b2288776f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.688372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984966a714d2442e9b5a2b0b2288776f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.695388 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984966a714d2442e9b5a2b0b2288776f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.708093 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984966a714d2442e9b5a2b0b2288776f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.715469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cd9e39ca-416b-4097-b6c7-099c84756568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984966a714d2442e9b5a2b0b2288776f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:53.721315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1373/2720] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:35:53 2022] DELETE /identity/v3/users/984966a714d2442e9b5a2b0b2288776f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:53.988446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:53.995204 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:54.009313 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25c19-d0f4-4d80-b82c-c01ea2e91abb admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.040573 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:54.068354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.068980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.069255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.069524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] PATH_INFO: `/v3/projects/2558b8041dd8468883b991833cb06d0e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.070644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2558b8041dd8468883b991833cb06d0e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.072537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.118713 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2558b8041dd8468883b991833cb06d0e', 'request_id': 'req-c20527e7-4998-4e6b-91f5-d73fb7533872'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:54.124783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2558b8041dd8468883b991833cb06d0e', 'request_id': 'req-c20527e7-4998-4e6b-91f5-d73fb7533872'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:54.130248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2558b8041dd8468883b991833cb06d0e', 'request_id': 'req-c20527e7-4998-4e6b-91f5-d73fb7533872'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:54.143251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] The token cache is being invalidate because project 2558b8041dd8468883b991833cb06d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:35:54.143543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:54.144188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-c20527e7-4998-4e6b-91f5-d73fb7533872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:35:54.145660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1348/2721] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:35:53 2022] DELETE /identity/v3/projects/2558b8041dd8468883b991833cb06d0e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:54.150577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.151400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.151860 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.172106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:54.173223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:54.191192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:54.234407 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1374/2722] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:54.243370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.243657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.243951 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.264364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:54.265572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:54.273399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1349/2723] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:54.278519 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.288290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e5d2c-258f-42e3-96b3-f0fe9d8f0c68 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.294577 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.295181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.295490 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.295784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.296430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:35:54.296731 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.298345 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.309822 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1375/2724] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:35:54.314372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.324631 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be2ecb-12de-4413-97e8-76e839b42dd0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.329372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.329964 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.330281 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.330562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.331200 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.333098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.361094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1350/2725] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:35:54 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:54.365181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.375084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdddb0f-a037-4b15-a43f-24c2e9d1842a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.431134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.431662 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.431968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.432315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.432983 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.434933 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.455847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1376/2726] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:35:54 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:35:54.459975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.471006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a04696-e221-4c32-b063-ac30f27e28ab admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.475674 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.476524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.476814 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.477093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.477728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.479398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.489134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1351/2727] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:35:54.492986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.503035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a653609-bb26-4159-826b-7894279e7bd8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.507644 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.508257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.508533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.508802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.509435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.511563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71b4cd-acaf-4a5e-b221-9e44ff8e7c9e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.521805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1377/2728] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:35:54.526545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.536364 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e536f30-0262-4839-bc95-93ed68fdfb65 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.540884 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.542139 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.542449 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.542723 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] PATH_INFO: `/v3/projects/efd555e71d034c6d8b283dd2b6f916a3/users/02d2c8c3b6914114acc22d556e502783/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.557518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd555e71d034c6d8b283dd2b6f916a3, user_id=02d2c8c3b6914114acc22d556e502783, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.560191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.574460 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1352/2729] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:35:54 2022] PUT /identity/v3/projects/efd555e71d034c6d8b283dd2b6f916a3/users/02d2c8c3b6914114acc22d556e502783/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:35:54.585150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bff-c646-4adf-927d-50dfb04fb8b5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.585760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bff-c646-4adf-927d-50dfb04fb8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.585760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141bff-c646-4adf-927d-50dfb04fb8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.616867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-00141bff-c646-4adf-927d-50dfb04fb8b5 None None] MFA Rules not processed for user `02d2c8c3b6914114acc22d556e502783`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:35:54.618110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-00141bff-c646-4adf-927d-50dfb04fb8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:54.689108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1378/2730] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:35:54.701699 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:35:54.703438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:35:54.771048 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:35:54.786065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8428cc-0dcd-4067-a03d-1f12babace5a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:35:54.789735 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55004b070d1e42968d2f8272071034bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:35:54.790372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:35:54.790653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:35:54.790927 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:35:54.799221 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:35:54.800652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:35:54.809788 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1353/2731] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:35:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:04.685777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:04.805359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=8 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:05.856703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:05.857321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:05.857321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:05.876258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] MFA Rules not processed for user `9a81b6fe6d8d42cdbd2c85d901c128f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:05.877471 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:05.933098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1379/2732] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:06.235852 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:06.237258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:06.294059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05899b65-5eaf-4a07-b114-54724e7d9edd service glance] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:06.297650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:06.298266 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:06.298549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:06.298820 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:06.300538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:06.309968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:06.311410 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:06.319189 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1354/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:06.641331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:06.642798 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:06.715980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb6fd1-e9f8-42a7-a541-0aa50d278da0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:06.720927 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:06.721542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:06.721821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:06.722092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:06.723859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:06.735915 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:06.737469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:06.748043 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1380/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:09.669507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:09.670968 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:09.754685 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809d557-dce4-48ff-b709-0629c1fda953 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:09.760127 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:09.760747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:09.761027 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:09.761301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:09.763109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:09.775586 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:09.777779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:09.788554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1355/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:16.743399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=57 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:18.730767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:18.745208 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7dc2-b47d-4755-a100-e92ff524b766 service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:18.750608 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:18.751319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:18.751670 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:18.752011 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:18.753834 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:18.767585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:18.769250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241074cd-ac78-4d55-b2f1-8d1c1b595182 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:18.781268 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1381/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:19.784017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=60 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:23.777054 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:23.837855 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487610b-a3d2-4664-a9e0-32c5b724a624 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:23.842392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:23.843011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:23.843288 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:23.843557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] PATH_INFO: `/v3/users/02d2c8c3b6914114acc22d556e502783` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:23.844655 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d2c8c3b6914114acc22d556e502783)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:23.846934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:23.892493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d2c8c3b6914114acc22d556e502783'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:23.893129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d2c8c3b6914114acc22d556e502783'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:23.893733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d2c8c3b6914114acc22d556e502783'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:23.900557 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d2c8c3b6914114acc22d556e502783'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:23.912465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d2c8c3b6914114acc22d556e502783'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:23.925351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1356/2737] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:36:23 2022] DELETE /identity/v3/users/02d2c8c3b6914114acc22d556e502783 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:36:23.929837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:23.930899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:23.931054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:23.949943 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:23.951182 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.010449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1382/2738] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:24.019839 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.021228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.078279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e43b7-e643-426a-8e37-12a95636384a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.081902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.082537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.082819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.083130 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.092318 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.093799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba264553-1745-4293-8181-f82898d2ec6b service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.104085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1357/2739] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:24.376313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.377891 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.390273 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc14c1-251e-45be-bc4a-e15830879f91 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.394902 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.395438 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.395713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.395987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] PATH_INFO: `/v3/projects/efd555e71d034c6d8b283dd2b6f916a3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.397228 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd555e71d034c6d8b283dd2b6f916a3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.399771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.446895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd555e71d034c6d8b283dd2b6f916a3', 'request_id': 'req-8a0826c9-7458-4b04-a52d-5fe5316dccc7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:24.452883 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd555e71d034c6d8b283dd2b6f916a3', 'request_id': 'req-8a0826c9-7458-4b04-a52d-5fe5316dccc7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:24.458402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd555e71d034c6d8b283dd2b6f916a3', 'request_id': 'req-8a0826c9-7458-4b04-a52d-5fe5316dccc7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:24.471335 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] The token cache is being invalidate because project efd555e71d034c6d8b283dd2b6f916a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:36:24.471624 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:24.472243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8a0826c9-7458-4b04-a52d-5fe5316dccc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:36:24.473697 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1383/2740] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:36:24 2022] DELETE /identity/v3/projects/efd555e71d034c6d8b283dd2b6f916a3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:36:24.479689 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.480001 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.480277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.500109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:24.501301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.518707 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:24.564010 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1358/2741] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:24.572686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.572964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.573235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.593406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:24.594661 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.603049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1384/2742] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:24.607245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.616749 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a9eb3-1920-44f7-b821-7b70c1c6e597 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.621501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.622088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.622396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.622668 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.623302 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:36:24.623600 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.625180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.637247 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1359/2743] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:36:24.641522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.651417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5def38-ed8c-4e3a-997c-786727623fde None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.656172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.656774 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.657054 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.657327 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.657964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.659903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.687282 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1385/2744] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:36:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:36:24.691347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.701936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6041a-787e-4c44-b64c-61ed14f1010b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.757646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.758819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.759094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.759367 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.760002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.761923 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.783241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1360/2745] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:36:24 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:36:24.788696 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.799311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb597a8-0d94-4ed7-bd59-00e541c64b2a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.803982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.804580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.804863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.805137 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.805806 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.807439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.817341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1386/2746] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:36:24.822071 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.832177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bcdc-faac-469e-a2f6-9ad02774cd45 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.837710 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.838376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.838677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.838949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.839594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.841198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887d6f-f9b3-48c3-9ddd-8411b77f6bff admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.852670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1361/2747] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:36:24.856808 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.866972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dbce7-fe39-4950-8abb-34e00bd55584 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:24.872309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:24.872954 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.873230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.873502 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] PATH_INFO: `/v3/projects/286e498f10064d4fb4cb65544cf12213/users/7cf0b21be580417cb5548d4d5a003a78/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.888543 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=286e498f10064d4fb4cb65544cf12213, user_id=7cf0b21be580417cb5548d4d5a003a78, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:24.891204 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:24.903663 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1387/2748] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:36:24 2022] PUT /identity/v3/projects/286e498f10064d4fb4cb65544cf12213/users/7cf0b21be580417cb5548d4d5a003a78/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:36:24.908549 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402298-5af2-45bc-b713-03322af8497e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:24.908836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402298-5af2-45bc-b713-03322af8497e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:24.909106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402298-5af2-45bc-b713-03322af8497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:24.927908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-27402298-5af2-45bc-b713-03322af8497e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:24.929102 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-27402298-5af2-45bc-b713-03322af8497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:24.987491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1362/2749] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:24.997545 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:24.999266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:25.009756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:25.057263 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f6aa-c079-4af3-a894-6bd999dad35f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:25.060771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:25.061372 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:25.061647 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:25.061992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:25.072652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:25.074123 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:25.083859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1388/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:25.695101 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a551c9-f7b2-410a-bb59-2d54b5a4dbea None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:25.695385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a551c9-f7b2-410a-bb59-2d54b5a4dbea None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:25.695664 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a551c9-f7b2-410a-bb59-2d54b5a4dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:25.725034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-77a551c9-f7b2-410a-bb59-2d54b5a4dbea None None] MFA Rules not processed for user `7cf0b21be580417cb5548d4d5a003a78`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:25.726357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-77a551c9-f7b2-410a-bb59-2d54b5a4dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:25.743931 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:25.794502 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1363/2751] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:25.805649 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:36:25.807163 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:25.871570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a4e2c-b58b-4873-9b65-be03989d752c service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:36:25.875356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:36:25.875941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:25.876217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:25.876491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:25.885672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:36:25.887108 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295f2bf-451d-422d-986e-f993e95ac992 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:36:25.895656 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1389/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:36:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:36:27.251640 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:36:27.252179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:36:27.252179 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:36:27.272451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] MFA Rules not processed for user `7cf0b21be580417cb5548d4d5a003a78`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:36:27.274341 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:36:27.281138 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1364/2753] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:36:35.891796 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=49 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:36:37.267630 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=22 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:37:03.185533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c269-0d60-43e8-9d74-988c960dd972 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:03.186134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c269-0d60-43e8-9d74-988c960dd972 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:03.186134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c269-0d60-43e8-9d74-988c960dd972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:03.206401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bfc5c269-0d60-43e8-9d74-988c960dd972 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:03.207607 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bfc5c269-0d60-43e8-9d74-988c960dd972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:03.215844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1390/2754] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:03.240612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:03.242066 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:03.313949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3806-681c-4161-bf18-9ada521aab75 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:03.320159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:03.320752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:03.321029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:03.321312 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:03.329217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:03.330817 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:03.340711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1365/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:07.252076 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede279-d37a-4cac-89c0-39ac2b8d5209 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:07.252659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede279-d37a-4cac-89c0-39ac2b8d5209 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:07.252659 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede279-d37a-4cac-89c0-39ac2b8d5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:07.273142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4dede279-d37a-4cac-89c0-39ac2b8d5209 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:07.274413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4dede279-d37a-4cac-89c0-39ac2b8d5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:07.282499 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1391/2756] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:07.312763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:07.324778 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8da61e-83f9-42c3-856b-eb373a08549e service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:07.330435 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:07.331156 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:07.331439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:07.331712 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:07.341967 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:07.343546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:07.353053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1366/2757] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:10.501491 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39290-9da6-4391-904b-9978b91ead1f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:10.502063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39290-9da6-4391-904b-9978b91ead1f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:10.502063 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39290-9da6-4391-904b-9978b91ead1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:10.521829 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d6d39290-9da6-4391-904b-9978b91ead1f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:10.523047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d6d39290-9da6-4391-904b-9978b91ead1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:10.530676 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1392/2758] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:37:10.552275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:10.563338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429051-27f7-42b7-a8af-64a63bf0c153 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:10.569131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:10.569715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:10.569992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:10.570287 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:10.578185 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:10.579774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:10.590160 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1367/2759] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:14.625873 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14b60-8117-4eba-9c45-f66c8295e8f2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:14.626426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14b60-8117-4eba-9c45-f66c8295e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:14.626426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a14b60-8117-4eba-9c45-f66c8295e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:14.646996 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-86a14b60-8117-4eba-9c45-f66c8295e8f2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:14.647813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-86a14b60-8117-4eba-9c45-f66c8295e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:14.655473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1393/2760] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:14.681899 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:14.694188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904fbb-fc09-438d-afdd-1b0baa0e9515 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:14.699653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:14.700284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:14.700562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:14.700857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:14.709347 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:14.710955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:14.720622 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1368/2761] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:18.809226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c90d-9a46-4d51-8856-df42fe2aac05 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:18.809811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c90d-9a46-4d51-8856-df42fe2aac05 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:18.809811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8c90d-9a46-4d51-8856-df42fe2aac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:18.833702 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5bc8c90d-9a46-4d51-8856-df42fe2aac05 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:18.835006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5bc8c90d-9a46-4d51-8856-df42fe2aac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:18.843539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1394/2762] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:18.867091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:18.878315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eb8ec-c31b-43bc-9ab5-4977cb2adf17 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:18.883844 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:18.884427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:18.884704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:18.884973 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:18.893036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:18.894629 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:18.903811 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1369/2763] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:23.006689 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:23.007424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:23.007424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:23.028768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:23.030555 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:23.039029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1395/2764] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:23.066488 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:23.078790 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca690848-bcd8-42eb-afdd-462348ded112 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:23.084624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:23.085217 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:23.085493 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:23.085765 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:23.095639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:23.097351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce73ced-9cab-4fd4-930c-ddf35c9908d6 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:23.108737 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1370/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:33.022356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=18 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:37:33.103437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=64 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:37:34.741869 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:34.757437 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254f0b5-04b9-4971-8c20-59253bc51a08 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:34.763501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:34.764126 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:34.764404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:34.764880 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:34.767573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:34.783744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:34.785341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba76eb-8aee-4f26-bfbf-3d4c486492fc service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:34.798042 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1396/2766] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:37:40.344818 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:40.345301 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:40.345396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:40.364955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] MFA Rules not processed for user `7cf0b21be580417cb5548d4d5a003a78`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:40.366136 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:40.373031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1371/2767] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:37:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:44.792322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:37:50.359612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:37:56.334719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5c55-4cad-4546-aa0e-34cf63ea1a69 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:56.334719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5c55-4cad-4546-aa0e-34cf63ea1a69 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:56.334719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff5c55-4cad-4546-aa0e-34cf63ea1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:56.375963 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8aff5c55-4cad-4546-aa0e-34cf63ea1a69 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:37:56.377394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8aff5c55-4cad-4546-aa0e-34cf63ea1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:37:56.386099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1397/2768] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:37:56.413983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:37:56.431359 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09c81b-46e9-4964-b586-70f3f4b52e61 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:37:56.437762 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:37:56.438499 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:37:56.438842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:37:56.439294 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:37:56.449430 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:37:56.451177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:37:56.464055 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1372/2769] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:00.620908 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d527-773f-471a-8d44-dec8bf0c45c2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:00.621396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d527-773f-471a-8d44-dec8bf0c45c2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:00.621501 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d527-773f-471a-8d44-dec8bf0c45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:00.641250 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff76d527-773f-471a-8d44-dec8bf0c45c2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:38:00.642484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff76d527-773f-471a-8d44-dec8bf0c45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:00.651044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1398/2770] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:38:00.673772 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:00.685949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbe4d3-7f82-4bea-9953-ed8687926879 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:00.691411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:00.692065 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:00.692372 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:00.692645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:00.700647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:00.702230 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:00.712338 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1373/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:05.791785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eca42-0f24-4e9b-be81-d173e2ab44a2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:05.792329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eca42-0f24-4e9b-be81-d173e2ab44a2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:05.792329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eca42-0f24-4e9b-be81-d173e2ab44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:05.812034 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-619eca42-0f24-4e9b-be81-d173e2ab44a2 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:38:05.813492 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-619eca42-0f24-4e9b-be81-d173e2ab44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:05.822701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1399/2772] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:38:05.849618 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:05.860962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593a947-91d1-4093-9b13-e462b750d009 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:05.866733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:05.867534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:05.867815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:05.868091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:05.876627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:05.879120 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af925-63c2-4947-99fa-2bcc42b6a628 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:05.888653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1374/2773] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:09.705872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:09.706854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:09.706854 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:09.726062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] MFA Rules not processed for user `9a81b6fe6d8d42cdbd2c85d901c128f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:38:09.727277 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:09.781216 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1400/2774] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:38:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:38:09.967577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947594f0-efa1-4d36-9821-672f1876ff68 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:09.968116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947594f0-efa1-4d36-9821-672f1876ff68 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:09.968283 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947594f0-efa1-4d36-9821-672f1876ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:09.989168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-947594f0-efa1-4d36-9821-672f1876ff68 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:38:09.990439 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-947594f0-efa1-4d36-9821-672f1876ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:09.998489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1375/2775] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:38:10.597495 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:10.611154 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63f012-bd9f-449b-b99e-30205ce577be None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:10.617439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:10.617777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:10.618058 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:10.618363 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:10.626952 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:10.629105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:10.638541 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1401/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:15.191610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:15.192177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:15.192177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:15.212384 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:38:15.213597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:15.222068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1376/2777] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Sep 9 13:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:38:15.384841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:15.396736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092738-54fe-4863-87f6-437ca2f6f8cf service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:15.402166 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:15.402785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:15.403062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:15.403333 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:15.412113 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:15.413673 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:15.422961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1402/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:25.207574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=24 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:38:25.418804 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=46 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:38:28.280358 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:28.281885 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:28.353100 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298eb2-3b53-4503-923e-90662ebda661 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:28.358079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:28.358726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:28.361089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:28.361380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:28.363224 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:28.375207 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:28.377348 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:28.387468 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1377/2779] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:38.383159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=32 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:38:49.528665 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:49.530134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:49.545361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbcab-5dc7-4194-b382-74dab13ed131 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:49.550493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:49.551159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:49.551441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:49.551897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:49.554233 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:38:49.567266 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:49.569708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:49.584206 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:49.586551 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1403/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:38:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:38:49.595511 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040833-e494-4f0e-9f6f-d4bfbd2bc1b2 service placement] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:49.602152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:49.602828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:49.603109 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:49.603382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] PATH_INFO: `/v3/users/7cf0b21be580417cb5548d4d5a003a78` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:49.604510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf0b21be580417cb5548d4d5a003a78)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:49.606473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:49.658881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf0b21be580417cb5548d4d5a003a78'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.659530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf0b21be580417cb5548d4d5a003a78'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.660131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf0b21be580417cb5548d4d5a003a78'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.667210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf0b21be580417cb5548d4d5a003a78'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.679507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf0b21be580417cb5548d4d5a003a78'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.693669 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1378/2781] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:38:49 2022] DELETE /identity/v3/users/7cf0b21be580417cb5548d4d5a003a78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:38:49.867038 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:38:49.877448 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3d303-ff9a-4d00-a202-671be2fa9e35 service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:38:49.935131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:38:49.935765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:38:49.936047 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:38:49.936323 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] PATH_INFO: `/v3/projects/286e498f10064d4fb4cb65544cf12213` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:38:49.937442 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286e498f10064d4fb4cb65544cf12213)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:38:49.941768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:38:49.992258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286e498f10064d4fb4cb65544cf12213', 'request_id': 'req-3a0a999e-15d1-41a7-a74a-689b4b347523'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:49.998279 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286e498f10064d4fb4cb65544cf12213', 'request_id': 'req-3a0a999e-15d1-41a7-a74a-689b4b347523'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:50.003713 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286e498f10064d4fb4cb65544cf12213', 'request_id': 'req-3a0a999e-15d1-41a7-a74a-689b4b347523'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:50.014978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] The token cache is being invalidate because project 286e498f10064d4fb4cb65544cf12213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:38:50.015265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:50.015876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a0a999e-15d1-41a7-a74a-689b4b347523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:38:50.017329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1404/2782] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:38:49 2022] DELETE /identity/v3/projects/286e498f10064d4fb4cb65544cf12213 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:38:59.689569 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:39:00.011969 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:39:34.314703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:39:34.316176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:39:34.393184 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32df50d-c894-4411-9753-ec6ef11e8be7 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:39:34.461809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:39:34.462396 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:39:34.462681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:39:34.462954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:39:34.464692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:39:34.525980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:39:34.527610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:39:34.537441 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1379/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:39:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:39:44.533187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=84 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:39:45.566789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:39:45.567285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:39:45.567399 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:39:45.587313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] MFA Rules not processed for user `9a81b6fe6d8d42cdbd2c85d901c128f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:39:45.588516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:39:45.595628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1405/2784] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:39:55.582406 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:40:34.141332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:40:34.142725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:40:34.199110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542ca8-9f7e-446e-bb04-c342e83bdbc8 service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:40:34.202791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:40:34.203394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:40:34.203676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:40:34.203952 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:40:34.205665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:40:34.215116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:40:34.216733 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:40:34.225018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1380/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:40:44.221429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=26 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:01.656935 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:01.658402 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:01.715629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113becb-03c8-4e8d-8ea6-f927d36a36de None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:01.719674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:01.720325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:01.720643 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:01.720957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:01.723006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:01.736722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:01.738175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:01.749988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1406/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:11.744201 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=26 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:14.847018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:14.848419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:14.859505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c72d7-9bf7-425c-a1f8-afae095f32d4 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:14.863090 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:14.863662 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:14.863944 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:14.864218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:14.865921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:14.930320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:14.931791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:14.941530 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1381/2787] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:17.720578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:17.722020 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:17.776229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:17.778146 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:17.799588 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d0e8a-003a-4235-9b6e-047b2d5d9bab service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:17.804688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:17.805327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:17.805605 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:17.805876 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] PATH_INFO: `/v3/users/9a81b6fe6d8d42cdbd2c85d901c128f8` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:17.807149 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a81b6fe6d8d42cdbd2c85d901c128f8)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:17.809254 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:17.829352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7417-0bb0-46c5-a2c2-dddf1689cf06 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:17.834955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:17.835568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:17.835847 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:17.836116 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:17.837830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:17.850773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:17.852384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:17.862695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1407/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:41:17.868747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a81b6fe6d8d42cdbd2c85d901c128f8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:17.869398 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a81b6fe6d8d42cdbd2c85d901c128f8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:17.870009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a81b6fe6d8d42cdbd2c85d901c128f8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:17.877996 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a81b6fe6d8d42cdbd2c85d901c128f8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:17.892018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-13585bde-068b-4a18-b71e-d37357fc3816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a81b6fe6d8d42cdbd2c85d901c128f8'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:17.905051 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1382/2789] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:17 2022] DELETE /identity/v3/users/9a81b6fe6d8d42cdbd2c85d901c128f8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:18.076572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.089497 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5d5e9-cbf8-4c60-a833-a30849a56b5e service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.154134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.154800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.155081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.155357 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] PATH_INFO: `/v3/projects/c4cfda82001344579f0cd49e5f87ed52` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.156771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cfda82001344579f0cd49e5f87ed52)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.158789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.206079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cfda82001344579f0cd49e5f87ed52', 'request_id': 'req-badf3d79-caef-4395-9086-cc04ae36d671'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:18.212234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cfda82001344579f0cd49e5f87ed52', 'request_id': 'req-badf3d79-caef-4395-9086-cc04ae36d671'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:18.217884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cfda82001344579f0cd49e5f87ed52', 'request_id': 'req-badf3d79-caef-4395-9086-cc04ae36d671'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:18.230510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] The token cache is being invalidate because project c4cfda82001344579f0cd49e5f87ed52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:18.230800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:18.231424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-badf3d79-caef-4395-9086-cc04ae36d671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:18.232961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1408/2790] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:18 2022] DELETE /identity/v3/projects/c4cfda82001344579f0cd49e5f87ed52 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:18.238866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.239150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.239421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.259505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:18.260627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:18.318647 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1383/2791] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:18.327756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.328064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.328344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.348325 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:18.349682 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:18.357679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1409/2792] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:18.362724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.372587 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621d1c-1371-4c5b-b1d9-1b2e5e3236b0 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.377831 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.378478 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.378759 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.379032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.379675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81444) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:18.379975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.381599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.383186 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:18.396370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1384/2793] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:18.400584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.410064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4bde-49c1-410c-acba-7a5a3ee5ce87 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.414719 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.415302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.415576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.415843 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.416465 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.418355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.430537 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:18.448133 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1410/2794] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:18.453108 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.463152 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e91c-627a-4689-a7b6-9c7c47c1dc4a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.519412 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dea79-cee0-4212-815a-46038264896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.519932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dea79-cee0-4212-815a-46038264896b admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.520212 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dea79-cee0-4212-815a-46038264896b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.520481 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dea79-cee0-4212-815a-46038264896b admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.521114 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dea79-cee0-4212-815a-46038264896b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.523059 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dea79-cee0-4212-815a-46038264896b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.544992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1385/2795] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:18.549087 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.559311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facb4d-454a-496b-9f6e-8b61e0bd0465 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.564722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.565306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.565579 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.565878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.566544 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.568414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.579104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1411/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:18.583089 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dea79-cee0-4212-815a-46038264896b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.593237 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dea79-cee0-4212-815a-46038264896b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.597986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.598609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.598891 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.599164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.599822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.601451 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58848c8b-265d-4746-aafa-986328b3a6b2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.612077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1386/2797] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:18.616200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.626965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316124-4899-44fc-a62f-b921fc8631a7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.631700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.632396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.632675 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.632948 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] PATH_INFO: `/v3/projects/4796b60c16724658b422e9b257c70e27/users/0539b5dd39a94f2fb2a48382916ddc44/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.647771 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4796b60c16724658b422e9b257c70e27, user_id=0539b5dd39a94f2fb2a48382916ddc44, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.650439 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.663359 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1412/2798] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:18 2022] PUT /identity/v3/projects/4796b60c16724658b422e9b257c70e27/users/0539b5dd39a94f2fb2a48382916ddc44/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:18.673859 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.674150 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.674465 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.702053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] MFA Rules not processed for user `0539b5dd39a94f2fb2a48382916ddc44`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:18.703845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:18.767270 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1387/2799] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:41:18.771886 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.833236 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56feece-cae2-4a26-8548-4e202b6988ed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.837800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.838417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.838694 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.838962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.839586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.841459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.870080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1413/2800] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:18.874626 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.885213 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af069c2-ef70-4fe4-b03c-635ad3ebb3fa None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.940925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.941523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.941800 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.942069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] PATH_INFO: `/v3/users` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.942990 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.944872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:18.954902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:18.969345 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1388/2801] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:18 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:18.973094 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:18.984211 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33e88-8eef-4b9d-825f-d99df2caf414 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:18.989078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:18.989686 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:18.989994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:18.990297 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:18.990947 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:18.992539 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:19.003951 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1414/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:41:19.008117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:19.019334 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5560-b2eb-46a5-991c-ea1a68b31808 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:19.024454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:19.025039 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:19.025333 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:19.025604 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] PATH_INFO: `/v3/projects/6b45edfb11a443ceb9b3136a39be681d/users/11bb1a5e6a9544feb73c353de1190706/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:19.040660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b45edfb11a443ceb9b3136a39be681d, user_id=11bb1a5e6a9544feb73c353de1190706, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:19.043366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:19.057744 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1389/2803] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:19 2022] PUT /identity/v3/projects/6b45edfb11a443ceb9b3136a39be681d/users/11bb1a5e6a9544feb73c353de1190706/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:19.062291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:19.073261 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623affee-ae59-4d6f-a4a0-5143969c1a73 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:19.129072 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:19.129684 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:19.129949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:19.130235 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:19.130894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:19.132469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872240c2-a84a-42a9-9b33-9b8c60ea4776 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:19.142125 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1415/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:19.146351 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:19.157085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e371dd-f44f-466b-8013-493254fa2a0a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:19.161873 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:19.162563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:19.162843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:19.163117 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] PATH_INFO: `/v3/projects/6b45edfb11a443ceb9b3136a39be681d/users/11bb1a5e6a9544feb73c353de1190706/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:19.165310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b45edfb11a443ceb9b3136a39be681d, user_id=11bb1a5e6a9544feb73c353de1190706, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:19.168118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:19.179235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1390/2805] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:19 2022] PUT /identity/v3/projects/6b45edfb11a443ceb9b3136a39be681d/users/11bb1a5e6a9544feb73c353de1190706/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:19.190421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:19.190705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:19.191024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:19.218620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] MFA Rules not processed for user `11bb1a5e6a9544feb73c353de1190706`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:19.219988 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:19.234104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:19.289556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1416/2806] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:19.301743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:19.303489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:19.360574 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ada68f-d096-4fd0-afc3-92669f11364c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:19.364580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:19.365177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:19.365452 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:19.365720 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:19.375192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:19.376615 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29386e5-d3f7-404c-b92c-153e3de5b3a3 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:19.386034 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1391/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:20.718522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:20.779422 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aadcd-c740-41eb-8c4b-a94677979b32 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:20.784867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:20.785481 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:20.785757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:20.786027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] PATH_INFO: `/v3/users/0539b5dd39a94f2fb2a48382916ddc44` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:20.787262 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0539b5dd39a94f2fb2a48382916ddc44)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:20.789197 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:20.837361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0539b5dd39a94f2fb2a48382916ddc44'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:20.837962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0539b5dd39a94f2fb2a48382916ddc44'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:20.845411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0539b5dd39a94f2fb2a48382916ddc44'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:20.857722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0539b5dd39a94f2fb2a48382916ddc44'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:20.864650 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0539b5dd39a94f2fb2a48382916ddc44'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:20.870424 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1417/2808] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:20 2022] DELETE /identity/v3/users/0539b5dd39a94f2fb2a48382916ddc44 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:20.875546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:20.876006 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:20.876103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:20.896663 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:20.897860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:20.957245 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1392/2809] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:20.966925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:20.968931 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:21.003089 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:21.027441 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2f0c9-4f34-46fb-9130-3d7b6042d758 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:21.031616 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:21.032207 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:21.032483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:21.032751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:21.041480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:21.042964 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:21.052958 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1418/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 13:41:21.315110 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:21.316539 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:21.331776 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e8e93-5bc2-4bb3-a4a1-808f400d4775 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:21.336399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:21.337035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:21.337828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:21.338099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] PATH_INFO: `/v3/projects/4796b60c16724658b422e9b257c70e27` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:21.339453 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4796b60c16724658b422e9b257c70e27)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:21.341355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:21.387804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4796b60c16724658b422e9b257c70e27', 'request_id': 'req-7ab556b9-a375-4c1c-82dc-888190f40157'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.389621 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:21.395228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4796b60c16724658b422e9b257c70e27', 'request_id': 'req-7ab556b9-a375-4c1c-82dc-888190f40157'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.401925 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4796b60c16724658b422e9b257c70e27', 'request_id': 'req-7ab556b9-a375-4c1c-82dc-888190f40157'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.414875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] The token cache is being invalidate because project 4796b60c16724658b422e9b257c70e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:21.415172 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.415784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.417241 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1393/2811] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:21 2022] DELETE /identity/v3/projects/4796b60c16724658b422e9b257c70e27 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:21.421198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:21.431046 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01675382-c29f-4375-8ad0-3b63b69fa51b service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:21.488462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:21.489084 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:21.489360 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:21.489632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] PATH_INFO: `/v3/users/11bb1a5e6a9544feb73c353de1190706` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:21.490786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bb1a5e6a9544feb73c353de1190706)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:21.492679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:21.537237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bb1a5e6a9544feb73c353de1190706'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.537885 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bb1a5e6a9544feb73c353de1190706'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.545180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bb1a5e6a9544feb73c353de1190706'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.557899 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bb1a5e6a9544feb73c353de1190706'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.564881 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-171e195a-5090-4f0a-8b19-d8b2ada43d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bb1a5e6a9544feb73c353de1190706'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.571185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1419/2812] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:21 2022] DELETE /identity/v3/users/11bb1a5e6a9544feb73c353de1190706 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:21.839594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:21.841122 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:21.855107 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab556b9-a375-4c1c-82dc-888190f40157 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:21.912838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:21.913473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:21.913657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:21.913948 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] PATH_INFO: `/v3/projects/6b45edfb11a443ceb9b3136a39be681d` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:21.915105 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b45edfb11a443ceb9b3136a39be681d)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:21.916992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:21.961791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b45edfb11a443ceb9b3136a39be681d', 'request_id': 'req-d63ea182-1195-42b9-8877-923352d97d1c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.967740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b45edfb11a443ceb9b3136a39be681d', 'request_id': 'req-d63ea182-1195-42b9-8877-923352d97d1c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.973819 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b45edfb11a443ceb9b3136a39be681d', 'request_id': 'req-d63ea182-1195-42b9-8877-923352d97d1c'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.986091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] The token cache is being invalidate because project 6b45edfb11a443ceb9b3136a39be681d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:21.986404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.987016 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-d63ea182-1195-42b9-8877-923352d97d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:21.988507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1394/2813] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:21 2022] DELETE /identity/v3/projects/6b45edfb11a443ceb9b3136a39be681d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:21.993361 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:21.993867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:21.993979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.013953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:22.015941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:22.065168 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:22.080391 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1420/2814] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:22.089483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.089769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.090040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.109858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:22.111093 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:22.118874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1395/2815] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:22.123069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.133030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff032ceb-dbe1-422e-9b60-6a38c55c3c6b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.137629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.138247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.138547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.138825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.139494 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:22.140430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.141986 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.153548 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1421/2816] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:22.158524 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.177728 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec00f4-990b-4716-9cf5-0d9cb0ced60b None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.182492 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.183097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.183378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.183650 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.184297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.186191 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.213467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1396/2817] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:22.217876 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.229210 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cab70-2bfa-4388-aa21-8a7914427989 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.284937 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.285542 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.285827 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.286096 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.286759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.288652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.309474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1422/2818] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:41:22.314454 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.324872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ad118-fcce-4fd8-838b-5abfc2be9db2 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.330194 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.330809 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.331086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.331357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.331991 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.333571 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.343446 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1397/2819] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:22.347377 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.357230 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458caf4-f4c0-4da0-adb4-3213fe795732 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.361896 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.362514 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.362793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.363064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.363695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.365290 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8271f-7873-48aa-80e4-b0a4bbb6e793 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.376612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1423/2820] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:22.381214 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.391698 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4000b9e-cefa-4ea0-be0b-696808dd714f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.396310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.396954 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.397231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.397505 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] PATH_INFO: `/v3/projects/182eac32739d48aa943da8d0aa7a806f/users/8a2fd0c61ee04556bc127a0e46a86b54/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.411620 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182eac32739d48aa943da8d0aa7a806f, user_id=8a2fd0c61ee04556bc127a0e46a86b54, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.414268 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.427904 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1398/2821] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:22 2022] PUT /identity/v3/projects/182eac32739d48aa943da8d0aa7a806f/users/8a2fd0c61ee04556bc127a0e46a86b54/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:22.438668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.438957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.439270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.467417 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] MFA Rules not processed for user `8a2fd0c61ee04556bc127a0e46a86b54`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:22.468733 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:22.531091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1424/2822] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:22.535536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.544444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:22.599155 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01158c-9278-4151-ae65-fe9e916ebf42 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.603777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.604380 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.604660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.604933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.605597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.607578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.634181 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1399/2823] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:41:22.638432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.649527 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f3537-a659-4a90-824f-e3464bb8cef4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.693416 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:22.706064 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.706691 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.706966 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.707243 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.707863 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.709757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.730269 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1425/2824] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:22.734769 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.744803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c719-1547-401b-937e-e6e879ede06f admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.749971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.750589 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.750865 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.751134 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.751763 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.753356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.763828 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1400/2825] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:22.768150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.778040 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea844d-7822-4938-a491-8e71c5edb9f6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.782704 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.783346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.783622 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.783894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] PATH_INFO: `/v3/projects/28d83604f56d42b0821656015169801b/users/fdb0e223191049d0a0a043be49ee8f3d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.799147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d83604f56d42b0821656015169801b, user_id=fdb0e223191049d0a0a043be49ee8f3d, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.801792 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.815524 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1426/2826] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:22 2022] PUT /identity/v3/projects/28d83604f56d42b0821656015169801b/users/fdb0e223191049d0a0a043be49ee8f3d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:22.819791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.829898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdab81-1800-47cc-bb2d-11a405be9741 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.885830 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.886458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.886739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.887009 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.887637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.889248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73694056-2f13-457f-809e-d4260e7e228e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.899229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1401/2827] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:22.903574 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:22.913666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae5033-5ee9-43db-b338-cc5443310b23 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:22.918319 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:22.918965 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.919247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.919520 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] PATH_INFO: `/v3/projects/28d83604f56d42b0821656015169801b/users/fdb0e223191049d0a0a043be49ee8f3d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.921968 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d83604f56d42b0821656015169801b, user_id=fdb0e223191049d0a0a043be49ee8f3d, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:22.924638 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:22.934734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1427/2828] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:22 2022] PUT /identity/v3/projects/28d83604f56d42b0821656015169801b/users/fdb0e223191049d0a0a043be49ee8f3d/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:22.946826 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:22.947310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:22.947310 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:22.974681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] MFA Rules not processed for user `fdb0e223191049d0a0a043be49ee8f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:22.975883 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:23.044857 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1402/2829] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:23.058989 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:23.060784 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:23.118735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7ad0-3207-48b2-89e6-58181e4495d3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:23.122368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:23.122982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:23.123241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:23.123511 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:23.179159 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:23.180575 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:23.189459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1428/2830] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:24.545297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:24.547357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:24.554106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:24.560678 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc12e-041e-43ef-9de7-4691b2ced25c None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:24.565067 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:24.565677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:24.565956 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:24.566280 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:24.575456 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:24.576882 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd161465-d25d-44f4-8226-4797a38d67bf service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:24.586980 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1403/2831] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:28.420132 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:28.475628 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:28.482629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643c9f9-6cc7-4034-8a25-b01cac5a4092 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:28.487725 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:28.488346 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:28.488620 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:28.488888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] PATH_INFO: `/v3/users/8a2fd0c61ee04556bc127a0e46a86b54` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:28.490014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2fd0c61ee04556bc127a0e46a86b54)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:28.491941 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:28.537066 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2fd0c61ee04556bc127a0e46a86b54'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:28.537712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2fd0c61ee04556bc127a0e46a86b54'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:28.545006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2fd0c61ee04556bc127a0e46a86b54'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:28.556715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2fd0c61ee04556bc127a0e46a86b54'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:28.564190 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2fd0c61ee04556bc127a0e46a86b54'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:28.570055 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1429/2832] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:28 2022] DELETE /identity/v3/users/8a2fd0c61ee04556bc127a0e46a86b54 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:28.574525 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:28.575011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:28.575129 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:28.594682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:28.595868 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:28.653636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1404/2833] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:28.663350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:28.664752 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:28.722800 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74784a9-0bce-4ecd-9f0b-72a8c27ebb72 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:28.726432 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:28.727032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:28.727306 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:28.727578 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:28.737317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:28.738766 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:28.747926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1430/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:29.013673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.015187 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:29.027447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7a37-8c24-4577-a5f1-8bf99098ad25 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.032939 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.033578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.033851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.034111 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] PATH_INFO: `/v3/projects/182eac32739d48aa943da8d0aa7a806f` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.035403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182eac32739d48aa943da8d0aa7a806f)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.037538 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.084908 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182eac32739d48aa943da8d0aa7a806f', 'request_id': 'req-97ea7719-aa00-42a1-b1b1-3ba108f94405'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.090992 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182eac32739d48aa943da8d0aa7a806f', 'request_id': 'req-97ea7719-aa00-42a1-b1b1-3ba108f94405'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.097031 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182eac32739d48aa943da8d0aa7a806f', 'request_id': 'req-97ea7719-aa00-42a1-b1b1-3ba108f94405'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.109932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] The token cache is being invalidate because project 182eac32739d48aa943da8d0aa7a806f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:29.110142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.110808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.112297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1405/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:29 2022] DELETE /identity/v3/projects/182eac32739d48aa943da8d0aa7a806f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:29.116339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.125906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3c013-c58b-48a9-bc38-1b436142bed1 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.181572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.182200 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.182505 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.182776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] PATH_INFO: `/v3/users/fdb0e223191049d0a0a043be49ee8f3d` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.183919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb0e223191049d0a0a043be49ee8f3d)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.185900 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.206890 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:29.232105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb0e223191049d0a0a043be49ee8f3d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.232756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb0e223191049d0a0a043be49ee8f3d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.240112 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb0e223191049d0a0a043be49ee8f3d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.251744 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb0e223191049d0a0a043be49ee8f3d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.258449 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-53bb90cb-400d-4476-ba97-a5075a6f9570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb0e223191049d0a0a043be49ee8f3d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.264160 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1431/2836] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:29 2022] DELETE /identity/v3/users/fdb0e223191049d0a0a043be49ee8f3d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:29.529799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.531881 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:29.545290 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea7719-aa00-42a1-b1b1-3ba108f94405 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.602816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.603515 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.603715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.603986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] PATH_INFO: `/v3/projects/28d83604f56d42b0821656015169801b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.605097 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d83604f56d42b0821656015169801b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.607025 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.622995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:29.654473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d83604f56d42b0821656015169801b', 'request_id': 'req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.661491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d83604f56d42b0821656015169801b', 'request_id': 'req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.667036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d83604f56d42b0821656015169801b', 'request_id': 'req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.679032 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] The token cache is being invalidate because project 28d83604f56d42b0821656015169801b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:29.679317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.679934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-b34ba02d-4c6e-4048-b742-ec4a2d3bdf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:29.681406 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1406/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:29 2022] DELETE /identity/v3/projects/28d83604f56d42b0821656015169801b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:29.686464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.686973 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.687140 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.706994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:29.708177 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:29.767387 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1432/2838] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:41:29.775096 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.775382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.775656 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.795405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:29.796724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:29.804473 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1407/2839] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:29.808717 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.819440 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672d74f-463a-4925-afa8-8ecdff73c540 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.824025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.824630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.824918 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.825192 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.825844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:29.826149 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.828337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.840115 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1433/2840] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:29.844637 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.854141 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8c0ae-e32a-4d1e-a73f-e6645ffa84a6 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.859070 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.859696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.859975 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.860258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.860887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.862840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.889665 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1408/2841] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:29 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:29.894370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:29.904302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdef436-22bb-4bb7-b19e-0aee19ed5744 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:29.960627 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:29.961225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:29.961506 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:29.961777 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:29.962421 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:29.964339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:29.985979 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1434/2842] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:29 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:29.990115 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.000829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd98740-e1c3-41b0-8f19-80c2ee8d6d6d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.005399 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.006017 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.006324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.006599 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.007225 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.008805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.019177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1409/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:30.022894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.032826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76491d2-a138-44d8-a1aa-8b29e9f81d8f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.037533 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.038124 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.038450 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.038708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.039348 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.040922 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eedf0-1029-452c-b8f4-86863935400d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.051426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1435/2844] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:30.055436 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.065946 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a033b-abf5-4ad5-8a27-e9a19bba754d admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.070862 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.071501 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.071779 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.072053 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] PATH_INFO: `/v3/projects/f6ddb8d0556741abb064e9f2793e02e2/users/13238fc71c4846b097db3d44243eba58/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.087945 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ddb8d0556741abb064e9f2793e02e2, user_id=13238fc71c4846b097db3d44243eba58, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.090848 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.104047 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1410/2845] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:30 2022] PUT /identity/v3/projects/f6ddb8d0556741abb064e9f2793e02e2/users/13238fc71c4846b097db3d44243eba58/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:30.115356 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.115645 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.115926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.123142 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:30.146821 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] MFA Rules not processed for user `13238fc71c4846b097db3d44243eba58`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:30.148065 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:30.212147 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1436/2846] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:30.216784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.278580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e833c-b5e2-463d-a58f-a17e07421729 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.283858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.284450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.284726 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.284995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.285614 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.287531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.313932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1411/2847] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:30 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:30.318462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.329286 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c44be-af61-43eb-98bf-0de12bbba9c2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.386202 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.386831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.387110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.387384 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.388025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.389976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.410874 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1437/2848] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:30 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:30.414897 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.425801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9d6bf-4e2c-4a38-9849-4c5c1161f45a admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.430495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.431092 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.431370 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.431645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.432316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.433943 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.445292 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1412/2849] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:30.449231 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.460371 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afff250-6d1a-4794-ae2e-be54adeb746e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.465019 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.465668 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.465945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.466241 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] PATH_INFO: `/v3/projects/4549a7480c5b4cee8b84128ad5d6359c/users/1902428a16944265a8517dc09bc9c75c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.480897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4549a7480c5b4cee8b84128ad5d6359c, user_id=1902428a16944265a8517dc09bc9c75c, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.483563 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.496894 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1438/2850] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:30 2022] PUT /identity/v3/projects/4549a7480c5b4cee8b84128ad5d6359c/users/1902428a16944265a8517dc09bc9c75c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:30.501654 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.511963 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4903-def2-47df-9776-002a2087f46e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.521003 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:30.570863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.571393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.571675 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.571947 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.572581 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.574233 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17f2f2-292d-408b-b5b6-dec5c1744cc5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.584197 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1413/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:30.588435 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.599270 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d57f8-b76c-4d11-b3f0-8d033778041f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.603846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.604484 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.604760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.605032 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] PATH_INFO: `/v3/projects/4549a7480c5b4cee8b84128ad5d6359c/users/1902428a16944265a8517dc09bc9c75c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.607052 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4549a7480c5b4cee8b84128ad5d6359c, user_id=1902428a16944265a8517dc09bc9c75c, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.610518 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.620553 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1439/2852] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:30 2022] PUT /identity/v3/projects/4549a7480c5b4cee8b84128ad5d6359c/users/1902428a16944265a8517dc09bc9c75c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:30.686068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.686677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.686677 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.717142 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] MFA Rules not processed for user `1902428a16944265a8517dc09bc9c75c`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:30.718385 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:30.789316 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1414/2853] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:30.799928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.801741 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:30.850428 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:30.862591 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c69d01-2d33-458a-bcc3-61e1fbc02e8d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.866318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.866923 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.867203 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.867473 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:30.876349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:30.877768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:30.887150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1440/2854] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:30.961411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:30.971804 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958a2a0-1bb2-4caf-8402-5fb90254c08e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:30.975366 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:30.975962 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:30.976238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:30.976508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:31.032416 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:31.033860 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c5a8f-b34c-4e68-9845-6ace4de96bf8 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:31.042627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1415/2855] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:35.103217 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:35.169180 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951305e-de62-4e19-aff9-11aaafa4b8ff service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:35.173872 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:35.174516 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:35.174797 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:35.175067 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] PATH_INFO: `/v3/users/13238fc71c4846b097db3d44243eba58` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:35.176172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13238fc71c4846b097db3d44243eba58)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:35.178060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:35.228789 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13238fc71c4846b097db3d44243eba58'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.229453 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13238fc71c4846b097db3d44243eba58'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.236678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13238fc71c4846b097db3d44243eba58'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.249078 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13238fc71c4846b097db3d44243eba58'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.256994 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13238fc71c4846b097db3d44243eba58'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.262811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1441/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:35 2022] DELETE /identity/v3/users/13238fc71c4846b097db3d44243eba58 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:35.268056 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:35.268575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:35.268714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:35.287694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:35.288978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:35.317835 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:35.348450 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1416/2857] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:41:35.358191 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:35.359807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:35.417355 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46580c-cf10-42b6-bc5a-5be638c6fb2f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:35.421071 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:35.421674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:35.421950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:35.422240 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:35.431859 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:35.433265 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:35.443666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1442/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:35.710354 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:35.711791 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:35.733799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3f52d-03bc-453c-bf7f-08c533bc8eaa None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:35.739782 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:35.740424 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:35.740706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:35.742262 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] PATH_INFO: `/v3/projects/f6ddb8d0556741abb064e9f2793e02e2` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:35.743866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ddb8d0556741abb064e9f2793e02e2)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:35.745983 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:35.793378 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ddb8d0556741abb064e9f2793e02e2', 'request_id': 'req-57b4c348-1818-4563-9bfc-2ba66415adad'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.800315 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ddb8d0556741abb064e9f2793e02e2', 'request_id': 'req-57b4c348-1818-4563-9bfc-2ba66415adad'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.806021 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ddb8d0556741abb064e9f2793e02e2', 'request_id': 'req-57b4c348-1818-4563-9bfc-2ba66415adad'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.818933 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] The token cache is being invalidate because project f6ddb8d0556741abb064e9f2793e02e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:35.819219 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.819842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.821381 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1417/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:35 2022] DELETE /identity/v3/projects/f6ddb8d0556741abb064e9f2793e02e2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:35.825321 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:35.835304 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ff3-6895-4fe1-8194-aeb389b8d2da service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:35.839928 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:35.893925 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:35.894512 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:35.894793 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:35.895069 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] PATH_INFO: `/v3/users/1902428a16944265a8517dc09bc9c75c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:35.896183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1902428a16944265a8517dc09bc9c75c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:35.898090 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:35.943742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1902428a16944265a8517dc09bc9c75c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.944393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1902428a16944265a8517dc09bc9c75c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.951803 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1902428a16944265a8517dc09bc9c75c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.963727 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1902428a16944265a8517dc09bc9c75c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.971009 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1b66fdf0-483f-4266-8aba-1acb8e4440c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1902428a16944265a8517dc09bc9c75c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:35.976736 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1443/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:35 2022] DELETE /identity/v3/users/1902428a16944265a8517dc09bc9c75c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:36.241466 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.242936 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:36.256682 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4c348-1818-4563-9bfc-2ba66415adad admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.315438 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.316104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.316332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.316607 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] PATH_INFO: `/v3/projects/4549a7480c5b4cee8b84128ad5d6359c` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.317978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4549a7480c5b4cee8b84128ad5d6359c)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.319932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.366151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4549a7480c5b4cee8b84128ad5d6359c', 'request_id': 'req-9331292e-3041-4f35-b339-2dbca8c0ba69'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:36.372311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4549a7480c5b4cee8b84128ad5d6359c', 'request_id': 'req-9331292e-3041-4f35-b339-2dbca8c0ba69'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:36.376145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:36.378140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4549a7480c5b4cee8b84128ad5d6359c', 'request_id': 'req-9331292e-3041-4f35-b339-2dbca8c0ba69'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:36.392041 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] The token cache is being invalidate because project 4549a7480c5b4cee8b84128ad5d6359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:36.392350 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:36.392972 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-9331292e-3041-4f35-b339-2dbca8c0ba69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:36.394469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1418/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:36 2022] DELETE /identity/v3/projects/4549a7480c5b4cee8b84128ad5d6359c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:36.399320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.399801 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.399924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.419756 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:36.420944 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:36.478837 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1444/2862] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:36.486657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.486974 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.487250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.507394 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:36.508606 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:36.517238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1419/2863] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:36.521396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.531035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f529d76-0491-41da-92fd-6a16458d9358 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.535660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.536257 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.536540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.536814 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.537462 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:36.537767 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.539404 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.551056 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1445/2864] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:36.555205 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.564832 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac94e-224a-4f92-a012-99528d78c6e9 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.569709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.570324 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.570602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.570872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.571495 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.573379 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.600284 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1420/2865] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:41:36.604378 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.614576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b3725-94b4-451f-858d-f919c156a963 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.626632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:36.673188 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.673722 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.674004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.674315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.674957 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.676867 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.699105 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1446/2866] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:36.703248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.714094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4a72-52e0-413a-82cc-5db0eb296604 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.718784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.719373 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.719657 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.719924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.720559 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.722180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.731934 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1421/2867] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:36.735841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.745773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f068b-498a-4e4b-b5be-370fab7c0f02 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.751185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.751780 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.752062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.752337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.752987 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.754614 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d581f9-194c-4eab-b917-ce4ac5b85ce9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.766409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1447/2868] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 13:41:36.770447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.780433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4f264-5e34-47ae-9185-85bcec9209e5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.785638 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.786317 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.786603 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.786877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] PATH_INFO: `/v3/projects/f9964dbdec2249d8b6d3c3a592c3bd29/users/371b69c5877c4228ba2d8cf3affc61e7/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.801774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9964dbdec2249d8b6d3c3a592c3bd29, user_id=371b69c5877c4228ba2d8cf3affc61e7, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.804469 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:36.819046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1422/2869] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:36 2022] PUT /identity/v3/projects/f9964dbdec2249d8b6d3c3a592c3bd29/users/371b69c5877c4228ba2d8cf3affc61e7/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:36.830080 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.830400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.830683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.858285 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] MFA Rules not processed for user `371b69c5877c4228ba2d8cf3affc61e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:36.859503 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:36.923634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1448/2870] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:36.928091 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:36.991085 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9be65-a9bc-4eee-bff5-8f6799903f7e admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:36.995989 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:36.996592 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:36.996874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:36.997147 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:36.997803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:36.999890 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.026806 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1423/2871] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:36 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:37.031252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.042588 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83506de1-f263-4f57-ba24-4b24371db81c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.099606 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.100206 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.100483 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.100757 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.101390 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.103311 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.127906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1449/2872] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:37 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:37.129711 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.140112 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b6e2-b5ff-46fa-bafa-2ed2fd3dbe8c admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.145536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.146132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.146434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.146706 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.147340 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.148921 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.161309 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1424/2873] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:37.165493 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.176146 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bbc43-2e64-45d5-a5cb-0911dd32634c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.180817 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.181460 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.181735 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.182006 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] PATH_INFO: `/v3/projects/19bbcee661464e8abba177aa1cc00863/users/38a8bab4ebc74dc4bbd614cbb458668c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.193252 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:37.197805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bbcee661464e8abba177aa1cc00863, user_id=38a8bab4ebc74dc4bbd614cbb458668c, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.200769 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.214631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1450/2874] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:37 2022] PUT /identity/v3/projects/19bbcee661464e8abba177aa1cc00863/users/38a8bab4ebc74dc4bbd614cbb458668c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:37.218646 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.231023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e372fd6-3236-489e-8654-4feda099c370 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.281215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:37.288636 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.289428 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.289738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.290036 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.290916 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.292932 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b206d19-3fd3-48d7-bcf5-aa9cb83e3d73 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.302766 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1425/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:37.308451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.319447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc140d-946a-47e0-a997-25e99db54253 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.324057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.324695 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.324972 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.325244 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] PATH_INFO: `/v3/projects/19bbcee661464e8abba177aa1cc00863/users/38a8bab4ebc74dc4bbd614cbb458668c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.327229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bbcee661464e8abba177aa1cc00863, user_id=38a8bab4ebc74dc4bbd614cbb458668c, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.330593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.340396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1451/2876] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:37 2022] PUT /identity/v3/projects/19bbcee661464e8abba177aa1cc00863/users/38a8bab4ebc74dc4bbd614cbb458668c/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:37.350188 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.350692 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.350842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.378803 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] MFA Rules not processed for user `38a8bab4ebc74dc4bbd614cbb458668c`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:37.380015 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:37.452671 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1426/2877] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:37.468030 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.470102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:37.529751 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed62ba7-b150-4673-b487-81f521e788ed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.533962 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.534550 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.534824 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.535092 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.544353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.545845 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.556924 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1452/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:37.660850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:37.670494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bc2f3-bf4e-420f-8ba1-5dbe8356e988 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:37.674807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:37.675403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:37.675683 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:37.675955 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:37.737019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:37.738494 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc596d-c8bd-478f-a845-a34dc1cf0331 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:37.747924 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1427/2879] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:40.345102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:40.405350 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e362a-e1b0-423d-82bd-34dd7dd339cc service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:40.410715 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:40.411341 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:40.411618 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:40.411888 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] PATH_INFO: `/v3/users/371b69c5877c4228ba2d8cf3affc61e7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:40.413004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=371b69c5877c4228ba2d8cf3affc61e7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:40.414945 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:40.461809 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371b69c5877c4228ba2d8cf3affc61e7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:40.462623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371b69c5877c4228ba2d8cf3affc61e7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:40.470759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371b69c5877c4228ba2d8cf3affc61e7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:40.482685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371b69c5877c4228ba2d8cf3affc61e7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:40.491318 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371b69c5877c4228ba2d8cf3affc61e7'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:40.492942 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:40.498405 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1453/2880] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:40 2022] DELETE /identity/v3/users/371b69c5877c4228ba2d8cf3affc61e7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:40.502887 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:40.503470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:40.503470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:40.522238 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:40.523421 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:40.581616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1428/2881] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:40.591164 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:40.592584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:40.649556 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec1c85-3e02-4e68-b340-93dc9973e13f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:40.653223 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:40.653828 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:40.654106 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:40.654409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:40.664375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:40.665786 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:40.675365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1454/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:40.947845 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:40.949297 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:40.962329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0121c-abce-45ca-bc77-0b6aabfe3270 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:40.967235 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:40.967874 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:40.968159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:40.968434 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] PATH_INFO: `/v3/projects/f9964dbdec2249d8b6d3c3a592c3bd29` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:40.970793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9964dbdec2249d8b6d3c3a592c3bd29)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:40.972851 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:40.984793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:41.020635 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9964dbdec2249d8b6d3c3a592c3bd29', 'request_id': 'req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.026799 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9964dbdec2249d8b6d3c3a592c3bd29', 'request_id': 'req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.032408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9964dbdec2249d8b6d3c3a592c3bd29', 'request_id': 'req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.045037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] The token cache is being invalidate because project f9964dbdec2249d8b6d3c3a592c3bd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:41.045326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.046103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.047653 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1429/2883] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:40 2022] DELETE /identity/v3/projects/f9964dbdec2249d8b6d3c3a592c3bd29 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:41.051669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.061349 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865fb7-3826-440a-87be-8b478c72ec1e service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.117561 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.118102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.118409 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.118683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] PATH_INFO: `/v3/users/38a8bab4ebc74dc4bbd614cbb458668c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.119785 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a8bab4ebc74dc4bbd614cbb458668c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.121672 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.167128 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a8bab4ebc74dc4bbd614cbb458668c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.167773 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a8bab4ebc74dc4bbd614cbb458668c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.175098 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a8bab4ebc74dc4bbd614cbb458668c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.187175 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a8bab4ebc74dc4bbd614cbb458668c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.194631 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-15a98686-1938-4f2b-b4e0-75141840326e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a8bab4ebc74dc4bbd614cbb458668c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.200423 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1455/2884] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:41 2022] DELETE /identity/v3/users/38a8bab4ebc74dc4bbd614cbb458668c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:41.465106 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.466577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:41.479861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9ad3-dba8-4a43-ae48-5b6cbdcd9d1b admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.537327 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.538002 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.538243 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.538523 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] PATH_INFO: `/v3/projects/19bbcee661464e8abba177aa1cc00863` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.539639 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bbcee661464e8abba177aa1cc00863)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.541596 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.587854 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bbcee661464e8abba177aa1cc00863', 'request_id': 'req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.593942 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bbcee661464e8abba177aa1cc00863', 'request_id': 'req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.599624 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bbcee661464e8abba177aa1cc00863', 'request_id': 'req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.612249 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] The token cache is being invalidate because project 19bbcee661464e8abba177aa1cc00863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:41.612537 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.613163 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-8aa222e8-23bc-4107-ab3b-c48b7deb3a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:41.614688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1430/2885] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:41 2022] DELETE /identity/v3/projects/19bbcee661464e8abba177aa1cc00863 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:41.619595 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.620068 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.620183 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.642525 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:41.643658 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:41.656411 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:41.705018 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1456/2886] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:41.712731 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.713023 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.713304 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.733858 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:41.735716 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:41.743704 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1431/2887] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:41.747905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.757648 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73ef2e-1d7c-4e91-b0dc-29f962daaaf4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.762185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.762810 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.763086 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.763353 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.763992 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:41.764294 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.765961 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.777205 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1457/2888] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:41.782040 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.791564 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958ef6-f2bb-4fb0-8ab8-a854f7394459 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.796177 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.796774 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.797784 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.798166 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.798840 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.800740 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.829483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1432/2889] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:41:41.833706 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.844309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc027113-a2ec-4d8e-a12b-5d4cd172059a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.900171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.900700 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.900982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.901256 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.901887 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.903901 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.926510 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1458/2890] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:41 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:41.930741 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.936218 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:41.942824 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c258b-1e41-4c83-a59b-1a65b1425069 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.949046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.949676 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.949960 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.950260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.950907 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.952510 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.963210 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1433/2891] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:41.967385 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:41.977799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590299a-2f15-42ef-bbb3-d747b5d2e440 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:41.982451 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:41.983045 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:41.983324 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:41.983597 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:41.984237 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:41.986811 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84e279-db7c-48cd-b020-dfdf980b8dbc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:41.997150 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1459/2892] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:42.001477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.011534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666331d-93be-4539-a1f3-fbe36dcd5ffa admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.016356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.016995 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.017277 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.017552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] PATH_INFO: `/v3/projects/a6bd11f2ba11481f9c0cfbf7d9a5b63b/users/4b5ea17f5755419884e6214f05691e7a/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.034880 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6bd11f2ba11481f9c0cfbf7d9a5b63b, user_id=4b5ea17f5755419884e6214f05691e7a, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.037617 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.051118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1434/2893] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:42 2022] PUT /identity/v3/projects/a6bd11f2ba11481f9c0cfbf7d9a5b63b/users/4b5ea17f5755419884e6214f05691e7a/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 13:41:42.062690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.062975 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.063247 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.090823 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] MFA Rules not processed for user `4b5ea17f5755419884e6214f05691e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:42.092017 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:42.157059 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1460/2894] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:42.161397 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.222357 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ba7dd-ad5e-4d24-883b-3030e7ce7a75 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.227649 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.228361 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.228644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.228920 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.229555 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.231506 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.260777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1435/2895] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:42 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:42.264870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.276225 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87a7d-8e44-424e-8db0-b72cd0a7645e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.288239 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:42.334131 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.334759 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.335039 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.335309 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.335949 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.337846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.359322 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1461/2896] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:42 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:42.363491 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.373812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353312e1-7d8b-414b-9998-2793283888a5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.378697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.379291 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.379572 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.379847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.380489 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.382081 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.393124 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1436/2897] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:42.397172 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.407870 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c7d5c-9787-4bdc-96dd-1041e51b2365 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.412401 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.413041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.413320 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.413596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] PATH_INFO: `/v3/projects/e22e4495c4e1454898273061ca57e0c6/users/5b2682a3038c4b899c052589fe789827/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.428024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22e4495c4e1454898273061ca57e0c6, user_id=5b2682a3038c4b899c052589fe789827, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.430703 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.443612 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1462/2898] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:42 2022] PUT /identity/v3/projects/e22e4495c4e1454898273061ca57e0c6/users/5b2682a3038c4b899c052589fe789827/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:42.447686 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.458050 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d414c-8958-4a6c-b07f-f6b3c5fe5bc6 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.513563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.514193 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.514507 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.514777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.515411 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.517752 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb097e26-f42b-4aa3-8d9a-c55d682ba803 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.527393 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1437/2899] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:42.531571 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.541911 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e63ee-64d8-4845-859b-f92ffd938ae4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.546530 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.547198 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.547480 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.547755 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] PATH_INFO: `/v3/projects/e22e4495c4e1454898273061ca57e0c6/users/5b2682a3038c4b899c052589fe789827/roles/ccc3dd5a4fb844cf892abf5afcf4c03e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.549669 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22e4495c4e1454898273061ca57e0c6, user_id=5b2682a3038c4b899c052589fe789827, role_id=ccc3dd5a4fb844cf892abf5afcf4c03e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.552394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.562984 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1463/2900] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:42 2022] PUT /identity/v3/projects/e22e4495c4e1454898273061ca57e0c6/users/5b2682a3038c4b899c052589fe789827/roles/ccc3dd5a4fb844cf892abf5afcf4c03e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:42.573464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.573957 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.574077 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.601950 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] MFA Rules not processed for user `5b2682a3038c4b899c052589fe789827`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:42.603201 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:42.628894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:42.670687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1438/2901] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:42.682014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.683825 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:42.743102 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd30cb-1b29-41f6-9bb9-518d0a2a9c1f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.746765 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.747366 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.747652 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.747950 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.757275 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.758720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.768077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1464/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:42.842764 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:42.853355 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84757442-e7f2-4023-93aa-aafef5e855ca None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:42.856978 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:42.857610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:42.857888 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:42.858161 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:42.914694 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:42.916159 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048cff-14a8-47b8-b00b-86b21ac8d917 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:42.925064 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1439/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:43.193749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:43.256955 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941a751-b70d-4045-8b17-ddf70e4127b1 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:43.261464 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:43.262085 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:43.262396 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:43.262683 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] PATH_INFO: `/v3/users/4b5ea17f5755419884e6214f05691e7a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:43.263776 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5ea17f5755419884e6214f05691e7a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:43.266540 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:43.278429 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:43.312050 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5ea17f5755419884e6214f05691e7a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.313413 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5ea17f5755419884e6214f05691e7a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.320582 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5ea17f5755419884e6214f05691e7a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.332802 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5ea17f5755419884e6214f05691e7a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.339568 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5ea17f5755419884e6214f05691e7a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.345365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1465/2904] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:43 2022] DELETE /identity/v3/users/4b5ea17f5755419884e6214f05691e7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:43.350118 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:43.350429 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:43.350703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:43.369836 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:43.371069 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:43.429540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1440/2905] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:43.439634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:43.441099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:43.501062 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d55e08-f639-41f8-b1e8-d856316f41f5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:43.504749 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:43.505358 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:43.505636 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:43.505907 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:43.514807 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:43.516930 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:43.526444 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1466/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:43.784898 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:43.786407 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:43.800743 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe1f45-f8c0-40dc-99ab-71af2bb1487e None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:43.805400 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:43.806018 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:43.806332 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:43.807116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] PATH_INFO: `/v3/projects/a6bd11f2ba11481f9c0cfbf7d9a5b63b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:43.808470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6bd11f2ba11481f9c0cfbf7d9a5b63b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:43.810325 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:43.861445 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6bd11f2ba11481f9c0cfbf7d9a5b63b', 'request_id': 'req-56d3e875-a449-4307-b0d4-03527b144cb5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.867483 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6bd11f2ba11481f9c0cfbf7d9a5b63b', 'request_id': 'req-56d3e875-a449-4307-b0d4-03527b144cb5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.869433 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:43.873894 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6bd11f2ba11481f9c0cfbf7d9a5b63b', 'request_id': 'req-56d3e875-a449-4307-b0d4-03527b144cb5'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.886917 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] The token cache is being invalidate because project a6bd11f2ba11481f9c0cfbf7d9a5b63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:43.887180 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.887783 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:43.889323 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1441/2907] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:43 2022] DELETE /identity/v3/projects/a6bd11f2ba11481f9c0cfbf7d9a5b63b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:43.893430 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:43.903184 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56cfa0-e5a4-407c-a923-15ad4a02bdc3 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:43.958475 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:43.959339 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:43.959626 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:43.959932 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] PATH_INFO: `/v3/users/5b2682a3038c4b899c052589fe789827` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:43.961060 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2682a3038c4b899c052589fe789827)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:43.963221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.001523 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:44.012289 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2682a3038c4b899c052589fe789827'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.012926 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2682a3038c4b899c052589fe789827'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.020459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2682a3038c4b899c052589fe789827'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.033081 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2682a3038c4b899c052589fe789827'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.039868 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-84e22ffd-7685-4ec3-8954-bf10944945c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2682a3038c4b899c052589fe789827'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.045760 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1467/2908] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:41:43 2022] DELETE /identity/v3/users/5b2682a3038c4b899c052589fe789827 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:44.313153 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.314643 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:44.329135 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3e875-a449-4307-b0d4-03527b144cb5 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.385660 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.386320 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.386598 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.386871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] PATH_INFO: `/v3/projects/e22e4495c4e1454898273061ca57e0c6` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.387971 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22e4495c4e1454898273061ca57e0c6)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.389850 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.435875 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22e4495c4e1454898273061ca57e0c6', 'request_id': 'req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.442164 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22e4495c4e1454898273061ca57e0c6', 'request_id': 'req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.448004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22e4495c4e1454898273061ca57e0c6', 'request_id': 'req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.461258 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] The token cache is being invalidate because project e22e4495c4e1454898273061ca57e0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:41:44.461545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.462793 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-6ffe5799-0f9b-40bd-a7c9-4174b6a3c657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:41:44.465594 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1442/2909] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:41:44 2022] DELETE /identity/v3/projects/e22e4495c4e1454898273061ca57e0c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:44.470025 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.470338 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.470630 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.489920 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:44.491091 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:44.553370 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1468/2910] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:44.561140 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.561444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.561697 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.583667 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:44.584866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:44.592751 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1443/2911] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:44.597919 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.608033 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c431a40-af90-4b4f-8593-c49591a5deaa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.612830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.613433 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.613716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.613991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.614678 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:41:44.614982 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.616576 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.628317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1469/2912] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:41:44.632540 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.642476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923057b-0be8-443f-8954-a6f3568abc1f None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.647098 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.647695 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.647976 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.648250 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.648877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.650843 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.681198 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1444/2913] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:41:44 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:44.682077 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.692813 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb685f81-9021-49a3-8aa9-b64ef41c0a4c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.750468 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.751187 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.751469 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.751742 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.752368 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.754308 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.777232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1470/2914] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:41:44 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:41:44.781545 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.795458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe866d3-ed7e-4867-9012-e25c61c0abce admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.800532 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.801244 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.801531 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.801805 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.802536 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.804132 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.815727 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1445/2915] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:44.819878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.833447 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb55ec0-98a0-46cd-964a-024a5d05bf86 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.837690 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.838337 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.838623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.838898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.839547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.841171 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d54ff-0d3e-432c-adc2-46b201903042 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.852892 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1471/2916] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:41:44.857086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:44.868405 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf637cee-b822-491c-8c68-992c307e23fe admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:44.873554 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:44.874256 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.874546 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.875311 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] PATH_INFO: `/v3/projects/950f7da450c44a68b84b519d5f2b3e32/users/990b8d9bbbbe42f4a6ed439cd4f525bb/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.891028 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950f7da450c44a68b84b519d5f2b3e32, user_id=990b8d9bbbbe42f4a6ed439cd4f525bb, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:44.893846 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:44.907330 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1446/2917] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:41:44 2022] PUT /identity/v3/projects/950f7da450c44a68b84b519d5f2b3e32/users/990b8d9bbbbe42f4a6ed439cd4f525bb/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:41:44.918978 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650cbb-4f19-47be-9bdf-d78ff20ef9dc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:44.919474 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650cbb-4f19-47be-9bdf-d78ff20ef9dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:44.919593 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650cbb-4f19-47be-9bdf-d78ff20ef9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:44.948977 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1c650cbb-4f19-47be-9bdf-d78ff20ef9dc None None] MFA Rules not processed for user `990b8d9bbbbe42f4a6ed439cd4f525bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:44.950291 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1c650cbb-4f19-47be-9bdf-d78ff20ef9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:44.956317 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:45.021134 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1472/2918] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:45.032714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:45.034543 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:45.048602 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:41:45.093215 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a3f4b-b831-41e0-92eb-6ccbc0399655 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:45.097440 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:45.098035 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:45.098343 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:45.098616 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:45.106816 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:45.108234 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:45.117672 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1447/2919] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:46.472476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:46.472976 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:46.473110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:46.491709 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] MFA Rules not processed for user `990b8d9bbbbe42f4a6ed439cd4f525bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:46.492906 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:46.500218 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1473/2920] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:41:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:47.206004 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:47.207534 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:47.283807 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec125-5403-4297-aebf-25aba72108e9 service cinder] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:47.288863 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:47.289464 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:47.289747 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:47.290024 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:47.291777 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:47.303775 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:47.305335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:47.316037 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1448/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:49.957775 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:49.959352 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:50.041654 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e5e85-7166-4fc8-8fa8-dfc07eac5af9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:50.047227 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:50.047841 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:50.048120 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:50.048427 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:50.050193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:50.062632 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:50.064831 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:50.076393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1474/2922] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:54.394584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:54.408403 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f241c-b2be-4595-9767-feb5bb7e254d service placement] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:54.413986 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b8e7a5dbd3e42f0930b893394256697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:54.414562 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:54.414842 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:54.415116 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:54.416896 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:54.429192 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:54.430802 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:54.442580 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1449/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:56.421374 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:56.422782 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:56.483781 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1da5-ce0e-45c4-a39c-1f2b3bf55061 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:56.487580 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:56.488298 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:56.488660 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:56.488953 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:56.490791 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:56.505079 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:56.506570 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a531820-70f9-4577-ae77-bf1e30e0b905 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:56.519029 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1475/2924] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:41:56.526467 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:56.538513 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ed418-f6c4-46df-8e1c-eacea833c78e service nova] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:56.542176 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:56.542808 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:56.543086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:56.543356 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:56.545229 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] Could not find project: 1db6f9dd59e849ccaa59c7896b476073.: keystone.exception.ProjectNotFound: Could not find project: 1db6f9dd59e849ccaa59c7896b476073. Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Sep 09 13:41:56.575703 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:41:56.577376 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self._validate_token_resources() Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 13:41:56.578801 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application with Lock( Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._enter() Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.creator() Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application created_value = creator( Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 13:41:56.581271 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 13:41:56.582442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1db6f9dd59e849ccaa59c7896b476073. Sep 09 13:41:56.582442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: ERROR keystone.server.flask.application Sep 09 13:41:56.582442 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1450/2925] 10.222.0.42 () {60 vars in 1396 bytes} [Fri Sep 9 13:41:56 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 113 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 09 13:41:56.618878 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6809d-9afc-4d7b-8a51-df1848029c10 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:56.619329 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6809d-9afc-4d7b-8a51-df1848029c10 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:56.619605 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6809d-9afc-4d7b-8a51-df1848029c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:56.660041 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-96e6809d-9afc-4d7b-8a51-df1848029c10 None None] MFA Rules not processed for user `9b8e7a5dbd3e42f0930b893394256697`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:41:56.661258 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-96e6809d-9afc-4d7b-8a51-df1848029c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:41:56.670567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1476/2926] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:41:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:41:56.684871 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:41:56.694724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dbe3f-1ce8-4641-85a5-624fedeabb43 service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:41:56.698812 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:41:56.699404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:41:56.699681 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:41:56.699949 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:41:56.711408 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:41:56.712841 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:41:56.723866 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1451/2927] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:42:00.493611 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbb136-19a1-4414-8806-11607529b909 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:00.494099 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbb136-19a1-4414-8806-11607529b909 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:00.494226 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbb136-19a1-4414-8806-11607529b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:00.512110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:00.544221 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-09bbb136-19a1-4414-8806-11607529b909 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:00.545426 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-09bbb136-19a1-4414-8806-11607529b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:00.609431 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1477/2928] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:42:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:00.654742 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:00.656231 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:00.723709 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=100 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:00.747382 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc89bc-6325-45c9-b056-addf4f90012d service neutron] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:00.752680 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:00.753282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:00.753563 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:00.753838 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:00.761902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:00.763526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:00.772073 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1452/2929] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:42:01.268903 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02d22-9751-4970-9666-0a41d12de05a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:01.269193 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02d22-9751-4970-9666-0a41d12de05a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:01.269476 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02d22-9751-4970-9666-0a41d12de05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:01.288895 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b5c02d22-9751-4970-9666-0a41d12de05a None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:01.290111 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b5c02d22-9751-4970-9666-0a41d12de05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:01.297292 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1478/2930] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 13:42:01.309610 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:01.321476 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af110a-083c-4e11-b450-386c240481e3 service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:01.326687 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:01.327275 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:01.327552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:01.327822 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:01.336815 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:01.338413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:01.346715 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1453/2931] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:42:01.571855 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab443-d679-4694-a4bb-314c0b5e10d3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:01.572365 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab443-d679-4694-a4bb-314c0b5e10d3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:01.572517 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab443-d679-4694-a4bb-314c0b5e10d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:01.591552 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-385ab443-d679-4694-a4bb-314c0b5e10d3 None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:01.592772 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-385ab443-d679-4694-a4bb-314c0b5e10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:01.600344 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1479/2932] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Sep 9 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:01.612558 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:01.623103 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca1c2c-07a4-4301-a67e-acfa8c13129f service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:01.629477 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:01.630011 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:01.630319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:01.630597 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:01.639094 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:01.640670 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:01.649566 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1454/2933] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:42:01.967615 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:01.967897 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:01.968170 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:01.988229 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] MFA Rules not processed for user `38bf5893ca6f4ee89cc56bdb1e839f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:01.989414 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:01.996375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1480/2934] 10.222.0.42 () {58 vars in 967 bytes} [Fri Sep 9 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:02.008609 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:02.019419 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e348e-63c2-4759-828d-d58f3f086dd2 service swift] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:02.024314 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a90385a931614a58ac3782a79b1a9457', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:02.024902 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:02.025178 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:02.025447 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:02.034079 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:02.035696 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16288-1d96-472f-bdbd-cfa58d762814 service swift] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:02.044847 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1455/2935] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Sep 9 13:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 13:42:04.317508 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:04.384234 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c73cf-ef4c-455e-9863-55bf39d952ee None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:04.388805 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:04.389425 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:04.389701 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:04.389971 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] PATH_INFO: `/v3/users/990b8d9bbbbe42f4a6ed439cd4f525bb` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:04.391118 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=990b8d9bbbbe42f4a6ed439cd4f525bb)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:04.393014 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:04.438826 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990b8d9bbbbe42f4a6ed439cd4f525bb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.439720 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990b8d9bbbbe42f4a6ed439cd4f525bb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.446884 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990b8d9bbbbe42f4a6ed439cd4f525bb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.453708 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:04.460558 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990b8d9bbbbe42f4a6ed439cd4f525bb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.467980 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990b8d9bbbbe42f4a6ed439cd4f525bb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.475049 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1481/2936] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:42:04 2022] DELETE /identity/v3/users/990b8d9bbbbe42f4a6ed439cd4f525bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:42:04.479575 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:04.480007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:04.480104 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:04.500029 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:04.501248 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:04.558577 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1456/2937] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:04.568598 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:04.570070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:04.627082 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c4bce-85e8-4d06-9f63-80f57722f7fc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:04.630705 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:04.631315 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:04.631587 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:04.631862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:04.640602 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:04.642024 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331110e4-577d-4721-96c6-13ba59e2d5fb service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:04.651871 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1482/2938] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:42:04.820276 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:04.821915 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:04.836861 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720326-2a98-4dc2-a380-5f52e6533e11 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:04.842673 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:04.843319 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:04.843612 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:04.843877 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] PATH_INFO: `/v3/projects/950f7da450c44a68b84b519d5f2b3e32` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:04.845019 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950f7da450c44a68b84b519d5f2b3e32)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:04.848046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:04.895427 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950f7da450c44a68b84b519d5f2b3e32', 'request_id': 'req-843418b3-1840-40a6-901b-c083e5c61440'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.901576 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950f7da450c44a68b84b519d5f2b3e32', 'request_id': 'req-843418b3-1840-40a6-901b-c083e5c61440'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.907470 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950f7da450c44a68b84b519d5f2b3e32', 'request_id': 'req-843418b3-1840-40a6-901b-c083e5c61440'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.919119 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] The token cache is being invalidate because project 950f7da450c44a68b84b519d5f2b3e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:42:04.919413 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.920068 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-843418b3-1840-40a6-901b-c083e5c61440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:04.921552 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1457/2939] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:42:04 2022] DELETE /identity/v3/projects/950f7da450c44a68b84b519d5f2b3e32 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:42:04.927035 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:04.927328 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:04.927629 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:04.947666 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:04.948875 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:05.008167 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1483/2940] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:05.015590 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.015878 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.016151 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.036547 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:05.037738 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:05.045458 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1458/2941] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:05.049573 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.059158 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c64d9e-e215-4d94-9498-c6e608e12e11 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.063768 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.064904 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.065185 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.065456 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.066395 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 13:42:05.066698 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.068274 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.080386 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1484/2942] 10.222.0.42 () {58 vars in 1153 bytes} [Fri Sep 9 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 13:42:05.084739 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.093645 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b5372-5b5c-4902-8a96-b8b3a29726a3 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.098578 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.099168 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.099444 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.099714 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.100336 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.102239 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.118099 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:05.131872 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1459/2943] 10.222.0.42 () {60 vars in 1153 bytes} [Fri Sep 9 13:42:05 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 13:42:05.136015 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.146693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeec00-1abb-4de7-8a4c-5b7c9b4bb8dd admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.203393 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.204027 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.204313 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.204585 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.205921 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.207898 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.225594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:05.234547 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1485/2944] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Sep 9 13:42:05 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 13:42:05.237748 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.248005 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef89e6e-e8e6-4eda-bf91-8baa82eccc63 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.253199 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.253797 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.254080 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.254404 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.255046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.256644 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.266560 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1460/2945] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:42:05.271070 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.281004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729978a-53da-4aa7-8a4d-5bcad77cad9e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.285830 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.286482 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.286762 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.287057 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.287693 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.289302 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec15a-555a-4ddc-aa56-557e2f6278ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.300342 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1486/2946] 10.222.0.42 () {58 vars in 1122 bytes} [Fri Sep 9 13:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 13:42:05.304518 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.315131 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a17a19-be7d-417e-9302-9c95206bbbd8 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.320086 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.320724 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.321007 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.321282 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] PATH_INFO: `/v3/projects/6485b594efff46c18cc8f63e08c02213/users/b1fb619710ed44c1a58cf467ae46c339/roles/ebb27a0ec3414c02a06b80ab33da6e0b` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.335725 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6485b594efff46c18cc8f63e08c02213, user_id=b1fb619710ed44c1a58cf467ae46c339, role_id=ebb27a0ec3414c02a06b80ab33da6e0b)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.338423 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.351125 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1461/2947] 10.222.0.42 () {60 vars in 1483 bytes} [Fri Sep 9 13:42:05 2022] PUT /identity/v3/projects/6485b594efff46c18cc8f63e08c02213/users/b1fb619710ed44c1a58cf467ae46c339/roles/ebb27a0ec3414c02a06b80ab33da6e0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:42:05.361584 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.362104 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.362248 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.390400 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] MFA Rules not processed for user `b1fb619710ed44c1a58cf467ae46c339`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:05.391625 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:05.455522 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1487/2948] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:42:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:05.466208 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:05.467909 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:05.524508 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b7126-e6fc-45bd-ab08-f85e031bb815 admin admin] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:05.528387 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e975eec1e5ff4fda97d9a51abd6240bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:05.529046 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] REQUEST_METHOD: `GET` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:05.529326 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:05.529601 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:05.537969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:05.539437 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8caac6-085d-455b-8293-97f9cb900741 service cinder] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:05.548174 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1462/2949] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:42:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:42:15.452679 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=37 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:15.544145 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:15.598586 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:15.659844 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d517ff-00a7-451a-9aa7-24473da5fcb8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:15.664394 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:15.665016 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:15.665295 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:15.665567 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] PATH_INFO: `/v3/users/b1fb619710ed44c1a58cf467ae46c339` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:15.666716 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fb619710ed44c1a58cf467ae46c339)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:15.668623 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:15.713685 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fb619710ed44c1a58cf467ae46c339'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:15.714254 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fb619710ed44c1a58cf467ae46c339'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:15.721420 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fb619710ed44c1a58cf467ae46c339'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:15.733596 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fb619710ed44c1a58cf467ae46c339'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:15.740846 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fb619710ed44c1a58cf467ae46c339'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:15.746592 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1488/2950] 10.222.0.42 () {58 vars in 1224 bytes} [Fri Sep 9 13:42:15 2022] DELETE /identity/v3/users/b1fb619710ed44c1a58cf467ae46c339 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:42:15.751648 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] REQUEST_METHOD: `POST` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:15.751940 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:15.752228 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:15.771688 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.auth.core [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] MFA Rules not processed for user `6ec940c1a9a046a9adaf049147f74a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81444) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 13:42:15.772895 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:15.832279 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1463/2951] 10.222.0.42 () {58 vars in 958 bytes} [Fri Sep 9 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 13:42:15.841905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:15.843373 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:15.900376 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55b72-8121-4ea1-a482-9e0e80882c45 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:15.904110 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f589a94d7e714f01bdf29794f8e4e5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:15.904712 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:15.904991 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:15.905267 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:15.914375 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:15.915799 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:15.925905 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1489/2952] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:42:16.190829 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] Authenticating user token {{(pid=81444) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:42:16.192260 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.fernet_utils [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81444) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:42:16.205633 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb6ec8-143b-447b-8026-5b9463742e39 None None] Validating token access rules against request {{(pid=81444) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:42:16.210329 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ec940c1a9a046a9adaf049147f74a4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7416d42f68304327bdde9d1c2d38a108', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81444) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:42:16.210969 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:42:16.211251 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:42:16.211526 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] PATH_INFO: `/v3/projects/6485b594efff46c18cc8f63e08c02213` {{(pid=81444) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:42:16.212750 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6485b594efff46c18cc8f63e08c02213)` {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:42:16.214584 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] RBAC: Authorization granted {{(pid=81444) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:42:16.262392 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6485b594efff46c18cc8f63e08c02213', 'request_id': 'req-7021d693-4d4c-4a11-9f40-8f04570430f4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:16.268652 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6485b594efff46c18cc8f63e08c02213', 'request_id': 'req-7021d693-4d4c-4a11-9f40-8f04570430f4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:16.274088 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6485b594efff46c18cc8f63e08c02213', 'request_id': 'req-7021d693-4d4c-4a11-9f40-8f04570430f4'} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:16.287335 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] The token cache is being invalidate because project 6485b594efff46c18cc8f63e08c02213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81444) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 13:42:16.287627 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:16.288255 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG keystone.notifications [None req-7021d693-4d4c-4a11-9f40-8f04570430f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81444) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 13:42:16.289789 dv-cinder-801354-9-smb devstack@keystone.service[81444]: [pid: 81444|app: 0|req: 1464/2953] 10.222.0.42 () {58 vars in 1233 bytes} [Fri Sep 9 13:42:16 2022] DELETE /identity/v3/projects/6485b594efff46c18cc8f63e08c02213 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 13:42:25.921232 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:42:26.284322 dv-cinder-801354-9-smb devstack@keystone.service[81444]: DEBUG dbcounter [-] [81444] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:43:40.437572 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 13:43:40.439331 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:43:40.575674 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d7cc5-7471-43c4-b41d-fe16a264d8c2 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 13:43:40.632862 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f10025eaa664fbc8fff276dfd1dafa0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d8ef8608cbd4262b00cde7d39b4e736', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 13:43:40.633459 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 13:43:40.633734 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 13:43:40.634004 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 13:43:40.635743 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 13:43:40.646634 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 13:43:40.648181 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b1d60-0f5d-4a7b-8845-e023b797d517 service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 13:43:40.658044 dv-cinder-801354-9-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1490/2954] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Sep 9 13:43:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 13:43:50.653594 dv-cinder-801354-9-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}